Dimitri Fontaine
f22eeec123
Allow LOAD CSV command to accept BEFORE LOAD DO and AFTER LOAD DO sections.
2013-10-10 23:37:49 +02:00
Dimitri Fontaine
bab53d1cd0
Improve testing, load commands from files.
2013-10-08 21:48:43 +02:00
Dimitri Fontaine
c01b693f21
Force MySQL identifiers that are PostgreSQL reserved keywords to be quoted.
2013-10-05 17:02:57 +02:00
Dimitri Fontaine
b12d71cfe0
Add a facility to better play with connection strings: with-database-uri.
2013-10-03 21:28:44 +02:00
Dimitri Fontaine
005b33d99f
Export more practical stuff in the main package, and make run-command smarter.
2013-10-03 21:00:16 +02:00
Dimitri Fontaine
2bf7c4df12
Assorted clean up to prepare a binary image.
2013-10-03 17:42:09 +02:00
Dimitri Fontaine
d3991690cf
Fix handling of CSV loading when not given fields nor columns lists.
2013-09-30 19:48:21 +02:00
Dimitri Fontaine
2a6c974f8e
Handle input file encodings.
2013-09-30 00:26:41 +02:00
Dimitri Fontaine
9bea12ed3e
Fix the LOAD FROM ARCHIVE command code paths until it actually works.
2013-09-28 23:45:24 +02:00
Dimitri Fontaine
6e3767bb37
Implement generic field to columns projection with support for user code.
...
And use that new facility in the Archive mode of operations, which is a
practical unit of testing and milestone to reach. We have enough code to
actually compile and try running the parser's output.
2013-09-25 00:01:46 +02:00
Dimitri Fontaine
b4e530981c
WIP implementing full archive fetching and downloading.
2013-09-24 18:34:05 +02:00
Dimitri Fontaine
7151a2ea62
Refactor transaction handling, depend on a patch to postmodern.
2013-09-23 11:30:20 +02:00
Dimitri Fontaine
ac4f9ff654
Code review, client messages, logs, summary, index naming and building.
2013-09-23 00:09:11 +02:00
Dimitri Fontaine
e75954c319
Remove the global kernel parameter, create as needed.
2013-09-22 15:12:43 +02:00
Dimitri Fontaine
e6d4c73c1b
Make Xach's db3 lib into its own asdf piece and integrate it with pgloader.
2013-09-19 00:42:35 +02:00
Dimitri Fontaine
0d43c31164
Have pgloader.syslog actually send data to PostgreSQL.
2013-09-18 15:38:55 +02:00
Dimitri Fontaine
ee1655b9cb
Parse the new syslog facility command, and fix usage of semicolons in passing.
2013-09-17 18:20:59 +02:00
Dimitri Fontaine
ff275e69f1
Preliminary parsing of syslog messages.
2013-08-29 11:42:49 +02:00
Dimitri Fontaine
f3b6054432
Begin working on importing from zip files with plenty of wild guessing...
2013-08-19 23:38:58 +02:00
Dimitri Fontaine
5ed766c570
Fully integrate data transformation rules.
2013-08-07 18:42:48 +02:00
Dimitri Fontaine
990c20d137
First stab at implementing parsed casting rules.
2013-08-06 17:28:45 +02:00
Dimitri Fontaine
c4679ffd5b
Add some transform utilities to be made available in the command language.
2013-07-30 23:20:38 -07:00
Dimitri Fontaine
7d874ffcca
Settle on a command language and begin implementing it.
2013-05-09 21:59:28 +02:00
Dimitri Fontaine
22246ccd2d
Add a COPY command parser, using esrap.
2013-05-09 15:44:17 +02:00
Dimitri Fontaine
bce51e4849
Clean-up packages to just :use pgloader.params
2013-03-16 23:20:51 +01:00
Dimitri Fontaine
72c783f02f
Add some preliminary logging capacity
2013-03-16 16:47:10 +01:00
Dimitri Fontaine
f4ac2b67db
Implement resetting all sequences at the end of the streaming.
2013-02-26 17:06:26 +01:00
Dimitri Fontaine
28da01ca78
Forgotten change to package.lisp to expose pgloader.pgsql:execute.
2013-02-24 16:46:32 +01:00
Dimitri Fontaine
2cbf43a271
Implement guessing CSV parameters.
2013-02-12 23:57:04 +01:00
Dimitri Fontaine
69bca34c46
Implement importing data from a CSV file.
2013-02-11 14:47:15 +01:00
Dimitri Fontaine
2c80996d85
Cleanup internal API and stats reporting.
2013-02-08 22:10:37 +01:00
Dimitri Fontaine
d795ac02c2
Send errors into separate files (logs, data), fix system loading and parameters.
2013-02-07 22:58:46 +01:00
Dimitri Fontaine
f6bdf64c7c
Cleanup the package definitions and inter-dependancy, and implement a proper data structure for sharing stats about what's happening.
2013-02-07 21:55:10 +01:00
Dimitri Fontaine
623e2d4ff7
Massive Refactoring, towards pgloader.
2013-02-07 00:04:12 +01:00
Dimitri Fontaine
1dfa170a49
First Import of the source tree for the Galaxya Loader.
2013-01-25 12:46:38 +01:00