Commit Graph

33 Commits

Author SHA1 Message Date
Dimitri Fontaine
c01b693f21 Force MySQL identifiers that are PostgreSQL reserved keywords to be quoted. 2013-10-05 17:02:57 +02:00
Dimitri Fontaine
b12d71cfe0 Add a facility to better play with connection strings: with-database-uri. 2013-10-03 21:28:44 +02:00
Dimitri Fontaine
005b33d99f Export more practical stuff in the main package, and make run-command smarter. 2013-10-03 21:00:16 +02:00
Dimitri Fontaine
2bf7c4df12 Assorted clean up to prepare a binary image. 2013-10-03 17:42:09 +02:00
Dimitri Fontaine
d3991690cf Fix handling of CSV loading when not given fields nor columns lists. 2013-09-30 19:48:21 +02:00
Dimitri Fontaine
2a6c974f8e Handle input file encodings. 2013-09-30 00:26:41 +02:00
Dimitri Fontaine
9bea12ed3e Fix the LOAD FROM ARCHIVE command code paths until it actually works. 2013-09-28 23:45:24 +02:00
Dimitri Fontaine
6e3767bb37 Implement generic field to columns projection with support for user code.
And use that new facility in the Archive mode of operations, which is a
practical unit of testing and milestone to reach. We have enough code to
actually compile and try running the parser's output.
2013-09-25 00:01:46 +02:00
Dimitri Fontaine
b4e530981c WIP implementing full archive fetching and downloading. 2013-09-24 18:34:05 +02:00
Dimitri Fontaine
7151a2ea62 Refactor transaction handling, depend on a patch to postmodern. 2013-09-23 11:30:20 +02:00
Dimitri Fontaine
ac4f9ff654 Code review, client messages, logs, summary, index naming and building. 2013-09-23 00:09:11 +02:00
Dimitri Fontaine
e75954c319 Remove the global kernel parameter, create as needed. 2013-09-22 15:12:43 +02:00
Dimitri Fontaine
e6d4c73c1b Make Xach's db3 lib into its own asdf piece and integrate it with pgloader. 2013-09-19 00:42:35 +02:00
Dimitri Fontaine
0d43c31164 Have pgloader.syslog actually send data to PostgreSQL. 2013-09-18 15:38:55 +02:00
Dimitri Fontaine
ee1655b9cb Parse the new syslog facility command, and fix usage of semicolons in passing. 2013-09-17 18:20:59 +02:00
Dimitri Fontaine
ff275e69f1 Preliminary parsing of syslog messages. 2013-08-29 11:42:49 +02:00
Dimitri Fontaine
f3b6054432 Begin working on importing from zip files with plenty of wild guessing... 2013-08-19 23:38:58 +02:00
Dimitri Fontaine
5ed766c570 Fully integrate data transformation rules. 2013-08-07 18:42:48 +02:00
Dimitri Fontaine
990c20d137 First stab at implementing parsed casting rules. 2013-08-06 17:28:45 +02:00
Dimitri Fontaine
c4679ffd5b Add some transform utilities to be made available in the command language. 2013-07-30 23:20:38 -07:00
Dimitri Fontaine
7d874ffcca Settle on a command language and begin implementing it. 2013-05-09 21:59:28 +02:00
Dimitri Fontaine
22246ccd2d Add a COPY command parser, using esrap. 2013-05-09 15:44:17 +02:00
Dimitri Fontaine
bce51e4849 Clean-up packages to just :use pgloader.params 2013-03-16 23:20:51 +01:00
Dimitri Fontaine
72c783f02f Add some preliminary logging capacity 2013-03-16 16:47:10 +01:00
Dimitri Fontaine
f4ac2b67db Implement resetting all sequences at the end of the streaming. 2013-02-26 17:06:26 +01:00
Dimitri Fontaine
28da01ca78 Forgotten change to package.lisp to expose pgloader.pgsql:execute. 2013-02-24 16:46:32 +01:00
Dimitri Fontaine
2cbf43a271 Implement guessing CSV parameters. 2013-02-12 23:57:04 +01:00
Dimitri Fontaine
69bca34c46 Implement importing data from a CSV file. 2013-02-11 14:47:15 +01:00
Dimitri Fontaine
2c80996d85 Cleanup internal API and stats reporting. 2013-02-08 22:10:37 +01:00
Dimitri Fontaine
d795ac02c2 Send errors into separate files (logs, data), fix system loading and parameters. 2013-02-07 22:58:46 +01:00
Dimitri Fontaine
f6bdf64c7c Cleanup the package definitions and inter-dependancy, and implement a proper data structure for sharing stats about what's happening. 2013-02-07 21:55:10 +01:00
Dimitri Fontaine
623e2d4ff7 Massive Refactoring, towards pgloader. 2013-02-07 00:04:12 +01:00
Dimitri Fontaine
1dfa170a49 First Import of the source tree for the Galaxya Loader. 2013-01-25 12:46:38 +01:00