Commit Graph

790 Commits

Author SHA1 Message Date
Dimitri Fontaine
2ff0d11332 Fix a typo in the com.informatimago.clext ASD dependency declaration. 2013-09-30 17:31:28 +02:00
Dimitri Fontaine
32d183efa5 Rework the summary handling in LOAD FROM ARCHIVE commands. 2013-09-30 16:04:01 +02:00
Dimitri Fontaine
9c1592c4eb Switch to using the unzip command rather than the CL implementation... 2013-09-30 14:23:19 +02:00
Dimitri Fontaine
2a6c974f8e Handle input file encodings. 2013-09-30 00:26:41 +02:00
Dimitri Fontaine
47257a173c Add some logs in the archive code. 2013-09-30 00:26:07 +02:00
Dimitri Fontaine
5ca4348e7e Fix handling of per-field NULL IF properties. 2013-09-29 22:26:20 +02:00
Dimitri Fontaine
9bea12ed3e Fix the LOAD FROM ARCHIVE command code paths until it actually works. 2013-09-28 23:45:24 +02:00
Dimitri Fontaine
a951d55f4c Don't try to probe-file tmpdir when it's nil. 2013-09-27 10:28:49 +02:00
Dimitri Fontaine
6e3767bb37 Implement generic field to columns projection with support for user code.
And use that new facility in the Archive mode of operations, which is a
practical unit of testing and milestone to reach. We have enough code to
actually compile and try running the parser's output.
2013-09-25 00:01:46 +02:00
Dimitri Fontaine
b4e530981c WIP implementing full archive fetching and downloading. 2013-09-24 18:34:05 +02:00
Dimitri Fontaine
4172374b61 Use CREATE TABLE IF NOT EXISTS in the db3 import. 2013-09-24 11:05:57 +02:00
Dimitri Fontaine
2ab8c74c49 Update docs to point ot the main Postmodern tree. 2013-09-23 15:34:39 +02:00
Dimitri Fontaine
fd578e7c63 Document the temporary dependency towards the patched version of Postmodern. 2013-09-23 15:28:20 +02:00
Dimitri Fontaine
699fcb21f2 Refactor to new Postmodern patch. 2013-09-23 15:25:02 +02:00
Dimitri Fontaine
7151a2ea62 Refactor transaction handling, depend on a patch to postmodern. 2013-09-23 11:30:20 +02:00
Dimitri Fontaine
fd2809277f Code cleanup: use with-stats-collection. 2013-09-23 09:58:41 +02:00
Dimitri Fontaine
ac4f9ff654 Code review, client messages, logs, summary, index naming and building. 2013-09-23 00:09:11 +02:00
Dimitri Fontaine
031a8bd15a First pass at thinking parallel: create indexes while copying next tables... 2013-09-22 16:37:04 +02:00
Dimitri Fontaine
e75954c319 Remove the global kernel parameter, create as needed. 2013-09-22 15:12:43 +02:00
Dimitri Fontaine
1a28a03e1f Add option "schema only" for MySQL migrations, cleanup code, fix identifer case for indexes. 2013-09-21 17:35:03 +02:00
Dimitri Fontaine
c9dd959fbd Implement MySQL migration option "downcase|quote identifier". 2013-09-20 22:52:45 +02:00
Dimitri Fontaine
020cd7d3ed Fix the code to handle lack of target type in MySQL cast rules parsing. 2013-09-20 22:51:44 +02:00
Dimitri Fontaine
dd38c9c154 Implement a command to load data from DBF files. 2013-09-20 15:00:26 +02:00
Dimitri Fontaine
7b97c687d7 Add a test case for parsing several commands at once. 2013-09-20 13:32:43 +02:00
Dimitri Fontaine
bc4927bbbb Allow to omit the target type definition in a MySQL cast definition. 2013-09-20 13:32:27 +02:00
Dimitri Fontaine
69b2cc119c Implement a first version of the LOAD CSV FROM command. 2013-09-20 13:14:49 +02:00
Dimitri Fontaine
3f89a00731 Fix CSV copy-from-file to be usable as-is, and fix conn spec passing. 2013-09-20 11:39:08 +02:00
Dimitri Fontaine
ba16f6f6b7 Alway quote identifiers when converting MySQL schema to PostgreSQL. 2013-09-20 10:26:02 +02:00
Dimitri Fontaine
2135c45763 Review default type casting rules from MySQL to PostgreSQL, include blobs. 2013-09-20 10:18:45 +02:00
Dimitri Fontaine
b072298937 It's unfortunately not possible to SET gucs once already in COPY "mode". 2013-09-19 23:32:53 +02:00
Dimitri Fontaine
bfcefce45f Fix passing *pg-settings* around in lparallel kernel bindings. 2013-09-19 23:32:17 +02:00
Dimitri Fontaine
24db93affd Fix handling of typemod, in particular with numeric data types. 2013-09-19 22:44:02 +02:00
Dimitri Fontaine
be0738d70a Implement casting of MySQL ENUM types. 2013-09-19 15:04:56 +02:00
Dimitri Fontaine
e6d4c73c1b Make Xach's db3 lib into its own asdf piece and integrate it with pgloader. 2013-09-19 00:42:35 +02:00
Dimitri Fontaine
bd6004e6b5 M-x delete-trailing-whitespace 2013-09-18 21:58:49 +02:00
Dimitri Fontaine
4aeec53ab4 Fix the syslog messages consumer to actually fill in data queues. 2013-09-18 17:41:27 +02:00
Dimitri Fontaine
b9d0edb0ee Fix pgloader.pgsql:get-connection-spec for port handling. 2013-09-18 17:40:43 +02:00
Dimitri Fontaine
0d43c31164 Have pgloader.syslog actually send data to PostgreSQL. 2013-09-18 15:38:55 +02:00
Dimitri Fontaine
20bbf827a3 Review LOAD MESSAGES FROM syntax to allow multiple grammars. 2013-09-18 13:11:04 +02:00
Dimitri Fontaine
ee1655b9cb Parse the new syslog facility command, and fix usage of semicolons in passing. 2013-09-17 18:20:59 +02:00
Dimitri Fontaine
eb04b34208 Remove unused files. 2013-09-17 10:57:47 +02:00
Dimitri Fontaine
b83228fa3e Small documentation enhancement. 2013-09-09 22:32:29 +02:00
Dimitri Fontaine
9fa7891346 Add an example of start-syslog-server usage as comments. 2013-09-09 22:31:43 +02:00
Dimitri Fontaine
d95bef644a Use the ABNF machinery in the syslog message receiver and parser. 2013-09-09 22:31:11 +02:00
Dimitri Fontaine
a48706d638 Add some more examples. 2013-09-09 22:30:53 +02:00
Dimitri Fontaine
6485101a16 Deduplicate entries in ABNF grammars to allow overloading, and use it. 2013-09-09 22:30:45 +02:00
Dimitri Fontaine
82d4c19386 Remove duplicate rules, actually allowing overriding inherited definitions. 2013-09-09 21:01:08 +02:00
Dimitri Fontaine
e7cb0047c4 Some more docs. 2013-09-09 20:58:16 +02:00
Dimitri Fontaine
24ce3244dd Expand docs, include regex support there. 2013-09-09 20:55:50 +02:00
Dimitri Fontaine
816df63008 Add *abnf-rsyslog* grammar. 2013-09-09 18:21:37 +02:00