Commit Graph

1568 Commits

Author SHA1 Message Date
Dimitri Fontaine
2f6c7677fc Fix "reset sequences" option to only target just loaded tables. 2013-10-21 23:15:24 +02:00
Dimitri Fontaine
f977c5a503 Fix MySQL database migration where the wrong database name was used in places. 2013-10-21 22:44:20 +02:00
Dimitri Fontaine
ffebcf3bc7 Clean out the code by splitting away a bunch of PostgreSQL related facilities. 2013-10-21 22:35:22 +02:00
Dimitri Fontaine
73de5b7186 Declare CSV projected fields ignorable in the generated code to be compiled. 2013-10-20 23:40:42 +02:00
Dimitri Fontaine
9fd0bbabe2 Yet another round of fixes for the test setup.
Including some Makefile hacks where test doesn't depend on the main pgloader
binary anymore because I coulnd't stop the binary to get being built again
even if it's been done already...
2013-10-20 23:27:11 +02:00
Dimitri Fontaine
5868a80717 Fix make test to run correctly in a VM environment. 2013-10-20 22:57:10 +02:00
Dimitri Fontaine
208d10c919 Review and clean the vagrant setup, add tests. 2013-10-20 22:51:06 +02:00
Dimitri Fontaine
fb818ee0e3 Move sources into their own subdirectory, assorted cleaning. 2013-10-20 19:09:09 +02:00
Dimitri Fontaine
031c62c663 Allow for some automated testing using vagrant. 2013-10-20 01:02:10 +02:00
Dimitri Fontaine
6d322fba7c Fix *default-tmpdir* setting when using /tmp/. 2013-10-20 01:01:29 +02:00
Dimitri Fontaine
f619054c79 Improve database connection parsing to use sensible defaults. 2013-10-19 22:39:09 +02:00
Dimitri Fontaine
a86ff9666e Have *pgconn-port* default to PGPORT env it set, or 5432. 2013-10-18 11:38:14 +02:00
Dimitri Fontaine
f768f74cbb Add support for comments (-- and /* */ style) in the command language. 2013-10-18 11:19:24 +02:00
Dimitri Fontaine
de7052e9d3 Document the --upgrade-config option. 2013-10-13 23:18:42 +02:00
Dimitri Fontaine
a97a228ec9 Add a --upgrade-config option to the main command line. 2013-10-13 23:15:29 +02:00
Dimitri Fontaine
8caf408c59 Fix the INI parsing to support setting "table" in a template. 2013-10-13 23:15:13 +02:00
Dimitri Fontaine
c84b8d63d1 Revise buildapp instructions now that we use our fork of cl-csv (temporarily). 2013-10-13 23:14:26 +02:00
Dimitri Fontaine
e1d2bd1318 Improve LOAD DBF command (support for http and zip). 2013-10-13 22:48:24 +02:00
Dimitri Fontaine
89aaabd179 Port tests from pgloader 2.x, implement trailing-sep. 2013-10-13 22:10:07 +02:00
Dimitri Fontaine
bfaf996265 Bugfix pgloader.pgsql::retry-batch (typo, forgot the columns). 2013-10-13 21:35:49 +02:00
Dimitri Fontaine
6d27d28287 Implement a converter from old .INI syntax to current commands. 2013-10-12 23:59:28 +02:00
Dimitri Fontaine
9e53e15067 Document the keep|trim unquoted blanks settings. 2013-10-12 15:11:36 +02:00
Dimitri Fontaine
7d1b34477e Implement CSV option keep|trim unquoted blanks. 2013-10-12 14:49:52 +02:00
Dimitri Fontaine
4ff7d9ae69 Improve documentation and empty strings test cases, now that cl-csv is fixed. 2013-10-12 14:36:35 +02:00
Dimitri Fontaine
138efc3690 Fix the man page synopsis. 2013-10-11 16:31:53 +02:00
Dimitri Fontaine
1407d379f1 Add support for the SET (gucs) option in the CSV commands. 2013-10-11 13:50:23 +02:00
Dimitri Fontaine
91f7f21917 Tweak the command filename processing to add logs. 2013-10-11 12:14:52 +02:00
Dimitri Fontaine
b762905953 Use our HTTP available very small test case for the archive tests. 2013-10-11 12:07:55 +02:00
Dimitri Fontaine
e374b51b41 Simplify code generation for before/after/finally sql blocks. 2013-10-11 12:07:38 +02:00
Dimitri Fontaine
38d5ad6829 Fix compilation warnings when not using before/after load constructs. 2013-10-11 11:56:12 +02:00
Dimitri Fontaine
1cf15b0f6f Add a NULL test case and fix some areas of the code to make it pass. 2013-10-11 11:20:35 +02:00
Dimitri Fontaine
3221ce6cc3 Add support for loading INLINE data in CSV commands. 2013-10-11 01:00:52 +02:00
Dimitri Fontaine
f22eeec123 Allow LOAD CSV command to accept BEFORE LOAD DO and AFTER LOAD DO sections. 2013-10-10 23:37:49 +02:00
Dimitri Fontaine
0397a20fb3 Add a --quiet option to the command line processing. 2013-10-10 20:59:28 +02:00
Dimitri Fontaine
5338854de1 Try not to setval() a sequence to 0, clamp the value to 1. 2013-10-09 11:24:52 +02:00
Dimitri Fontaine
dc55962389 Fix the #! script to have the same behaviour as the main binary executable. 2013-10-09 10:44:38 +02:00
Dimitri Fontaine
62c402b0e5 Improve the main command line facility to match the documentation. 2013-10-09 00:20:47 +02:00
Dimitri Fontaine
a8eb5beb73 New Documentation, intended to be delivered as a man page. 2013-10-09 00:20:24 +02:00
Dimitri Fontaine
cbc7b602d6 The with-pgsql-transaction macro should take care of *pg-settings*. 2013-10-09 00:19:52 +02:00
Dimitri Fontaine
91359060c3 Convert MySQL smallint and tinyint to PostgreSQL smallint. 2013-10-09 00:19:26 +02:00
Dimitri Fontaine
ceb839ba9d Fix the command line ordering when using a Manifest file for building the standalone binary. 2013-10-08 22:43:37 +02:00
Dimitri Fontaine
65035b1bc6 Allow for loading CSV files not using any field quoting. 2013-10-08 22:16:52 +02:00
Dimitri Fontaine
bab53d1cd0 Improve testing, load commands from files. 2013-10-08 21:48:43 +02:00
Dimitri Fontaine
0e79aca3bc Fix the processing of bad rows, needs a Postmodern fix too.
See https://github.com/marijnh/Postmodern/issues/39 for details.
2013-10-06 23:09:27 +02:00
Dimitri Fontaine
5a235de5c5 Add support for MySQL point datatype, where we need using astext(col). 2013-10-06 21:01:11 +02:00
Dimitri Fontaine
922aa22d64 Implement a MySQL list-views function to prepare for VIEWS support. 2013-10-06 18:44:46 +02:00
Dimitri Fontaine
446df213bd Filter out VIEWS from the current MySQL migration processing. 2013-10-06 18:09:49 +02:00
Dimitri Fontaine
236c9ffdf5 Fix the PostgreSQL Reset Sequences code. 2013-10-06 12:04:37 +02:00
Dimitri Fontaine
314ee9611a Fix MySQL default cast rules to include bigint auto_increment to bigserial. 2013-10-06 12:04:23 +02:00
Dimitri Fontaine
fe68fba3d3 Assorted MySQL migration bugfixes (reset sequence formating, etc). 2013-10-05 22:38:09 +02:00