Commit Graph

814 Commits

Author SHA1 Message Date
Dimitri Fontaine
9fd0bbabe2 Yet another round of fixes for the test setup.
Including some Makefile hacks where test doesn't depend on the main pgloader
binary anymore because I coulnd't stop the binary to get being built again
even if it's been done already...
2013-10-20 23:27:11 +02:00
Dimitri Fontaine
5868a80717 Fix make test to run correctly in a VM environment. 2013-10-20 22:57:10 +02:00
Dimitri Fontaine
208d10c919 Review and clean the vagrant setup, add tests. 2013-10-20 22:51:06 +02:00
Dimitri Fontaine
fb818ee0e3 Move sources into their own subdirectory, assorted cleaning. 2013-10-20 19:09:09 +02:00
Dimitri Fontaine
031c62c663 Allow for some automated testing using vagrant. 2013-10-20 01:02:10 +02:00
Dimitri Fontaine
6d322fba7c Fix *default-tmpdir* setting when using /tmp/. 2013-10-20 01:01:29 +02:00
Dimitri Fontaine
f619054c79 Improve database connection parsing to use sensible defaults. 2013-10-19 22:39:09 +02:00
Dimitri Fontaine
a86ff9666e Have *pgconn-port* default to PGPORT env it set, or 5432. 2013-10-18 11:38:14 +02:00
Dimitri Fontaine
f768f74cbb Add support for comments (-- and /* */ style) in the command language. 2013-10-18 11:19:24 +02:00
Dimitri Fontaine
de7052e9d3 Document the --upgrade-config option. 2013-10-13 23:18:42 +02:00
Dimitri Fontaine
a97a228ec9 Add a --upgrade-config option to the main command line. 2013-10-13 23:15:29 +02:00
Dimitri Fontaine
8caf408c59 Fix the INI parsing to support setting "table" in a template. 2013-10-13 23:15:13 +02:00
Dimitri Fontaine
c84b8d63d1 Revise buildapp instructions now that we use our fork of cl-csv (temporarily). 2013-10-13 23:14:26 +02:00
Dimitri Fontaine
e1d2bd1318 Improve LOAD DBF command (support for http and zip). 2013-10-13 22:48:24 +02:00
Dimitri Fontaine
89aaabd179 Port tests from pgloader 2.x, implement trailing-sep. 2013-10-13 22:10:07 +02:00
Dimitri Fontaine
bfaf996265 Bugfix pgloader.pgsql::retry-batch (typo, forgot the columns). 2013-10-13 21:35:49 +02:00
Dimitri Fontaine
6d27d28287 Implement a converter from old .INI syntax to current commands. 2013-10-12 23:59:28 +02:00
Dimitri Fontaine
9e53e15067 Document the keep|trim unquoted blanks settings. 2013-10-12 15:11:36 +02:00
Dimitri Fontaine
7d1b34477e Implement CSV option keep|trim unquoted blanks. 2013-10-12 14:49:52 +02:00
Dimitri Fontaine
4ff7d9ae69 Improve documentation and empty strings test cases, now that cl-csv is fixed. 2013-10-12 14:36:35 +02:00
Dimitri Fontaine
138efc3690 Fix the man page synopsis. 2013-10-11 16:31:53 +02:00
Dimitri Fontaine
1407d379f1 Add support for the SET (gucs) option in the CSV commands. 2013-10-11 13:50:23 +02:00
Dimitri Fontaine
91f7f21917 Tweak the command filename processing to add logs. 2013-10-11 12:14:52 +02:00
Dimitri Fontaine
b762905953 Use our HTTP available very small test case for the archive tests. 2013-10-11 12:07:55 +02:00
Dimitri Fontaine
e374b51b41 Simplify code generation for before/after/finally sql blocks. 2013-10-11 12:07:38 +02:00
Dimitri Fontaine
38d5ad6829 Fix compilation warnings when not using before/after load constructs. 2013-10-11 11:56:12 +02:00
Dimitri Fontaine
1cf15b0f6f Add a NULL test case and fix some areas of the code to make it pass. 2013-10-11 11:20:35 +02:00
Dimitri Fontaine
3221ce6cc3 Add support for loading INLINE data in CSV commands. 2013-10-11 01:00:52 +02:00
Dimitri Fontaine
f22eeec123 Allow LOAD CSV command to accept BEFORE LOAD DO and AFTER LOAD DO sections. 2013-10-10 23:37:49 +02:00
Dimitri Fontaine
0397a20fb3 Add a --quiet option to the command line processing. 2013-10-10 20:59:28 +02:00
Dimitri Fontaine
5338854de1 Try not to setval() a sequence to 0, clamp the value to 1. 2013-10-09 11:24:52 +02:00
Dimitri Fontaine
dc55962389 Fix the #! script to have the same behaviour as the main binary executable. 2013-10-09 10:44:38 +02:00
Dimitri Fontaine
62c402b0e5 Improve the main command line facility to match the documentation. 2013-10-09 00:20:47 +02:00
Dimitri Fontaine
a8eb5beb73 New Documentation, intended to be delivered as a man page. 2013-10-09 00:20:24 +02:00
Dimitri Fontaine
cbc7b602d6 The with-pgsql-transaction macro should take care of *pg-settings*. 2013-10-09 00:19:52 +02:00
Dimitri Fontaine
91359060c3 Convert MySQL smallint and tinyint to PostgreSQL smallint. 2013-10-09 00:19:26 +02:00
Dimitri Fontaine
ceb839ba9d Fix the command line ordering when using a Manifest file for building the standalone binary. 2013-10-08 22:43:37 +02:00
Dimitri Fontaine
65035b1bc6 Allow for loading CSV files not using any field quoting. 2013-10-08 22:16:52 +02:00
Dimitri Fontaine
bab53d1cd0 Improve testing, load commands from files. 2013-10-08 21:48:43 +02:00
Dimitri Fontaine
0e79aca3bc Fix the processing of bad rows, needs a Postmodern fix too.
See https://github.com/marijnh/Postmodern/issues/39 for details.
2013-10-06 23:09:27 +02:00
Dimitri Fontaine
5a235de5c5 Add support for MySQL point datatype, where we need using astext(col). 2013-10-06 21:01:11 +02:00
Dimitri Fontaine
922aa22d64 Implement a MySQL list-views function to prepare for VIEWS support. 2013-10-06 18:44:46 +02:00
Dimitri Fontaine
446df213bd Filter out VIEWS from the current MySQL migration processing. 2013-10-06 18:09:49 +02:00
Dimitri Fontaine
236c9ffdf5 Fix the PostgreSQL Reset Sequences code. 2013-10-06 12:04:37 +02:00
Dimitri Fontaine
314ee9611a Fix MySQL default cast rules to include bigint auto_increment to bigserial. 2013-10-06 12:04:23 +02:00
Dimitri Fontaine
fe68fba3d3 Assorted MySQL migration bugfixes (reset sequence formating, etc). 2013-10-05 22:38:09 +02:00
Dimitri Fontaine
09a49f4771 MySQL also has a "timestamp" datatype, register default casts and handle the default value CURRENT_TIMESTAMP properly: without quoting. 2013-10-05 21:29:26 +02:00
Dimitri Fontaine
57725a72d1 Fix quoting of the table name in MySQL migration for a single table. 2013-10-05 21:05:20 +02:00
Dimitri Fontaine
0769e145b4 Inline functions used within per-row loops. 2013-10-05 18:22:47 +02:00
Dimitri Fontaine
ef6eb2bd3c Allow filtering the MySQL migration to a single table from the command language. 2013-10-05 18:02:42 +02:00