Commit Graph

1568 Commits

Author SHA1 Message Date
Dimitri Fontaine
1f42318bb2 Import DBF v3 file reader from Xach, with permissions. 2013-08-31 23:11:54 +02:00
Dimitri Fontaine
33253c85cf Syslog receiver: assorted fixes, some test cases. 2013-08-31 23:11:23 +02:00
Dimitri Fontaine
ff275e69f1 Preliminary parsing of syslog messages. 2013-08-29 11:42:49 +02:00
Dimitri Fontaine
f03c3e9cde Document libmysqlclient-dev dependency in the installation steps. 2013-08-28 10:37:52 +02:00
Dimitri Fontaine
3421305dc8 Remove unused testing code. 2013-08-28 10:37:36 +02:00
Dimitri Fontaine
0af0ac315c Remove useless block of example code. 2013-08-21 17:26:36 +02:00
Dimitri Fontaine
a4901d546f Guess the column types from the first line... 2013-08-20 00:34:17 +02:00
Dimitri Fontaine
f3b6054432 Begin working on importing from zip files with plenty of wild guessing... 2013-08-19 23:38:58 +02:00
Dimitri Fontaine
6b7af735ae Fix parsing of GUCs, accept either = or to. 2013-08-09 11:54:20 +02:00
Dimitri Fontaine
19e43297b4 Review the README file, we're still pretty light on docs. 2013-08-09 10:01:37 +02:00
Dimitri Fontaine
6f6f40051a Fix a typo. 2013-08-08 18:29:11 +02:00
Dimitri Fontaine
59b931bae4 Fix the comment for the pgloader.mysql::fix-nulls function. 2013-08-08 17:14:54 +02:00
Dimitri Fontaine
8bfb525d2d Fix MySQL empty strings when returned as NULLs... 2013-08-08 17:11:11 +02:00
Dimitri Fontaine
e78106c60b Implement GUCs handling. 2013-08-08 17:10:33 +02:00
Dimitri Fontaine
d0ded0a917 Cleanup the casting rules and transforms implementation. 2013-08-08 17:10:02 +02:00
Dimitri Fontaine
5ed766c570 Fully integrate data transformation rules. 2013-08-07 18:42:48 +02:00
Dimitri Fontaine
990c20d137 First stab at implementing parsed casting rules. 2013-08-06 17:28:45 +02:00
Dimitri Fontaine
7b2b208e59 Actually produce code from the LOAD DATABASE FROM command. 2013-08-05 18:23:27 +02:00
Dimitri Fontaine
d385a14897 Add *cast-rules* to keep *default-cast-rules* as default values. 2013-08-05 15:57:47 +02:00
Dimitri Fontaine
51b3ad795e Add INTO clause to load database from, and fix the clause. 2013-08-05 15:57:14 +02:00
Dimitri Fontaine
c4679ffd5b Add some transform utilities to be made available in the command language. 2013-07-30 23:20:38 -07:00
Dimitri Fontaine
d0e392e4a8 Fix parsing type names in CAST definitions. 2013-07-30 23:17:33 -07:00
Dimitri Fontaine
f94b17ac1e Add tests to the casting rules support, and fix it. 2013-07-30 23:09:28 -07:00
Dimitri Fontaine
96e81d3f76 Implement parsing of the USING functions for data transformations. 2013-07-30 22:32:47 -07:00
Dimitri Fontaine
800df8e91d Use the new casting rules facilities in mysql.lisp 2013-07-30 21:15:26 -07:00
Dimitri Fontaine
3c5c384837 Implement dynamic casting rules. 2013-07-16 17:43:35 +02:00
Dimitri Fontaine
238ef6e8b8 Implement parsing a LOAD DATABASE FROM command syntax. 2013-06-07 18:49:43 +02:00
Dimitri Fontaine
7d874ffcca Settle on a command language and begin implementing it. 2013-05-09 21:59:28 +02:00
Dimitri Fontaine
912485d27e Move the constant coercing to read time. 2013-05-09 16:27:21 +02:00
Dimitri Fontaine
22246ccd2d Add a COPY command parser, using esrap. 2013-05-09 15:44:17 +02:00
Dimitri Fontaine
06bbc8cdda Ensure that the configured log directory do exists before opening the logfile in there. 2013-03-21 09:52:03 +01:00
Dimitri Fontaine
dfd35ba9da Add some more ideas to the TODO. 2013-03-18 18:33:11 +01:00
Dimitri Fontaine
995ef02a42 Use LISTEN/NOTIFY to avoid counting sequences twice. 2013-03-18 18:33:02 +01:00
Dimitri Fontaine
13fcf9f096 Clean-up connection parameters and their default values. 2013-03-16 23:21:32 +01:00
Dimitri Fontaine
bce51e4849 Clean-up packages to just :use pgloader.params 2013-03-16 23:20:51 +01:00
Dimitri Fontaine
5674191534 Switch to the new lparalel.queue:make-queue API. 2013-03-16 23:20:23 +01:00
Dimitri Fontaine
72c783f02f Add some preliminary logging capacity 2013-03-16 16:47:10 +01:00
Dimitri Fontaine
c6c3f11ffe Make it possible to target a PostgreSQL database named differently than the MySQL source database. 2013-03-14 17:17:17 +01:00
Dimitri Fontaine
3e9d8c0468 The portable :external-format name seems to be :utf-8 2013-03-14 15:37:54 +01:00
Dimitri Fontaine
d2b040f197 Tweak the special declarations to enhance readability. 2013-03-10 23:03:21 +01:00
Dimitri Fontaine
28164457c0 Simplify the code by using the dynamic variables properties. 2013-03-10 22:35:52 +01:00
Dimitri Fontaine
debe605427 Implement timing reporting in pgloader.pgsql:copy-from-file 2013-03-09 14:42:35 +01:00
Dimitri Fontaine
713594b5fc Fix batch splitting and retrying. 2013-03-09 14:34:17 +01:00
Dimitri Fontaine
d08ef5aeb7 Take the column type definition such as char(24) rather than just char 2013-03-05 10:54:05 +01:00
Dimitri Fontaine
f4ac2b67db Implement resetting all sequences at the end of the streaming. 2013-02-26 17:06:26 +01:00
Dimitri Fontaine
8042dff854 No need to "use" a given MySQL database when qualifying table names 2013-02-24 23:15:33 +01:00
Dimitri Fontaine
9f596ef4a8 Improve create table/index section names. 2013-02-24 16:53:03 +01:00
Dimitri Fontaine
9aac8ae68b Review the new API around columns and indexes, add a better reporting for them. 2013-02-24 16:46:57 +01:00
Dimitri Fontaine
28da01ca78 Forgotten change to package.lisp to expose pgloader.pgsql:execute. 2013-02-24 16:46:32 +01:00
Dimitri Fontaine
e2d2a48872 Implement migrating indexes, enhance columns query. 2013-02-24 00:10:32 +01:00