Commit Graph

847 Commits

Author SHA1 Message Date
Dimitri Fontaine
d0e392e4a8 Fix parsing type names in CAST definitions. 2013-07-30 23:17:33 -07:00
Dimitri Fontaine
f94b17ac1e Add tests to the casting rules support, and fix it. 2013-07-30 23:09:28 -07:00
Dimitri Fontaine
96e81d3f76 Implement parsing of the USING functions for data transformations. 2013-07-30 22:32:47 -07:00
Dimitri Fontaine
800df8e91d Use the new casting rules facilities in mysql.lisp 2013-07-30 21:15:26 -07:00
Dimitri Fontaine
3c5c384837 Implement dynamic casting rules. 2013-07-16 17:43:35 +02:00
Dimitri Fontaine
238ef6e8b8 Implement parsing a LOAD DATABASE FROM command syntax. 2013-06-07 18:49:43 +02:00
Dimitri Fontaine
7d874ffcca Settle on a command language and begin implementing it. 2013-05-09 21:59:28 +02:00
Dimitri Fontaine
912485d27e Move the constant coercing to read time. 2013-05-09 16:27:21 +02:00
Dimitri Fontaine
22246ccd2d Add a COPY command parser, using esrap. 2013-05-09 15:44:17 +02:00
Dimitri Fontaine
06bbc8cdda Ensure that the configured log directory do exists before opening the logfile in there. 2013-03-21 09:52:03 +01:00
Dimitri Fontaine
dfd35ba9da Add some more ideas to the TODO. 2013-03-18 18:33:11 +01:00
Dimitri Fontaine
995ef02a42 Use LISTEN/NOTIFY to avoid counting sequences twice. 2013-03-18 18:33:02 +01:00
Dimitri Fontaine
13fcf9f096 Clean-up connection parameters and their default values. 2013-03-16 23:21:32 +01:00
Dimitri Fontaine
bce51e4849 Clean-up packages to just :use pgloader.params 2013-03-16 23:20:51 +01:00
Dimitri Fontaine
5674191534 Switch to the new lparalel.queue:make-queue API. 2013-03-16 23:20:23 +01:00
Dimitri Fontaine
72c783f02f Add some preliminary logging capacity 2013-03-16 16:47:10 +01:00
Dimitri Fontaine
c6c3f11ffe Make it possible to target a PostgreSQL database named differently than the MySQL source database. 2013-03-14 17:17:17 +01:00
Dimitri Fontaine
3e9d8c0468 The portable :external-format name seems to be :utf-8 2013-03-14 15:37:54 +01:00
Dimitri Fontaine
d2b040f197 Tweak the special declarations to enhance readability. 2013-03-10 23:03:21 +01:00
Dimitri Fontaine
28164457c0 Simplify the code by using the dynamic variables properties. 2013-03-10 22:35:52 +01:00
Dimitri Fontaine
debe605427 Implement timing reporting in pgloader.pgsql:copy-from-file 2013-03-09 14:42:35 +01:00
Dimitri Fontaine
713594b5fc Fix batch splitting and retrying. 2013-03-09 14:34:17 +01:00
Dimitri Fontaine
d08ef5aeb7 Take the column type definition such as char(24) rather than just char 2013-03-05 10:54:05 +01:00
Dimitri Fontaine
f4ac2b67db Implement resetting all sequences at the end of the streaming. 2013-02-26 17:06:26 +01:00
Dimitri Fontaine
8042dff854 No need to "use" a given MySQL database when qualifying table names 2013-02-24 23:15:33 +01:00
Dimitri Fontaine
9f596ef4a8 Improve create table/index section names. 2013-02-24 16:53:03 +01:00
Dimitri Fontaine
9aac8ae68b Review the new API around columns and indexes, add a better reporting for them. 2013-02-24 16:46:57 +01:00
Dimitri Fontaine
28da01ca78 Forgotten change to package.lisp to expose pgloader.pgsql:execute. 2013-02-24 16:46:32 +01:00
Dimitri Fontaine
e2d2a48872 Implement migrating indexes, enhance columns query. 2013-02-24 00:10:32 +01:00
Dimitri Fontaine
b6f9b249ba Implement MySQL Schema Support (create table) 2013-02-21 22:41:54 +01:00
Dimitri Fontaine
2cbf43a271 Implement guessing CSV parameters. 2013-02-12 23:57:04 +01:00
Dimitri Fontaine
4bdfc4097f Implement some CSV parse error handling. 2013-02-11 22:10:50 +01:00
Dimitri Fontaine
69bca34c46 Implement importing data from a CSV file. 2013-02-11 14:47:15 +01:00
Dimitri Fontaine
9524007e8a Fix the importing from a PostgreSQL COPY TEXT file. 2013-02-11 13:40:07 +01:00
Dimitri Fontaine
4353d168fe Refactor the copy-from-queue and its error management. 2013-02-10 22:33:32 +01:00
Dimitri Fontaine
9e5f669553 Reset *state* from within top level functions, run.lisp runs some tests now. 2013-02-08 22:22:53 +01:00
Dimitri Fontaine
2c80996d85 Cleanup internal API and stats reporting. 2013-02-08 22:10:37 +01:00
Dimitri Fontaine
a9d6b7c2c7 Assorted changes (defaults, log file management). 2013-02-08 12:35:54 +01:00
Dimitri Fontaine
d795ac02c2 Send errors into separate files (logs, data), fix system loading and parameters. 2013-02-07 22:58:46 +01:00
Dimitri Fontaine
f6bdf64c7c Cleanup the package definitions and inter-dependancy, and implement a proper data structure for sharing stats about what's happening. 2013-02-07 21:55:10 +01:00
Dimitri Fontaine
08f7791f66 Arrange to report errors per table in the reports. 2013-02-07 18:15:01 +01:00
Dimitri Fontaine
68a49835de fix an off-by-one error and condition reporting. 2013-02-07 17:21:42 +01:00
Dimitri Fontaine
56e1afbe26 Update TODO 2013-02-07 15:33:06 +01:00
Dimitri Fontaine
edb12ce3f8 Implement basic error management of data so that COPY still imports the good rows. 2013-02-07 15:26:29 +01:00
Dimitri Fontaine
623e2d4ff7 Massive Refactoring, towards pgloader. 2013-02-07 00:04:12 +01:00
Dimitri Fontaine
b9c7dbb77b Cleanup, and rely on a patch in progress for lparallel.queue (bounding size). 2013-01-28 23:21:48 +01:00
Dimitri Fontaine
1dfa170a49 First Import of the source tree for the Galaxya Loader. 2013-01-25 12:46:38 +01:00