Dimitri Fontaine
be4cc804c0
Show usage and help when the command line options are not recognized.
2014-01-24 09:22:02 +01:00
Dimitri Fontaine
e8fcb15c27
Fix another hasty commit erroneously containing a for-tests change.
2014-01-23 23:29:27 +01:00
Dimitri Fontaine
b374d4bc8b
The current retry method has no need for *copy-batch-split*.
2014-01-23 23:28:25 +01:00
Dimitri Fontaine
d132bafc07
Refrain from parsing a non-existing command file...
2014-01-23 23:17:34 +01:00
Dimitri Fontaine
3f61c66a79
Also handle extra columns in CSV parsing.
2014-01-23 15:15:42 +01:00
Dimitri Fontaine
516ef08c37
Allow loading ragged CSV files.
2014-01-23 15:07:05 +01:00
Dimitri Fontaine
4cbe4b3218
Manage the whole class of "integrity violation" errors.
2014-01-23 14:59:46 +01:00
Dimitri Fontaine
59e87b84a0
Release Candidate 8.
2014-01-23 00:26:08 +01:00
Dimitri Fontaine
9455752805
Review and simplify batch retry processing.
2014-01-23 00:15:57 +01:00
Dimitri Fontaine
7c238f45f2
Fix batch retry handling, broken in previous refactoring. Fixes #22 .
2014-01-22 22:52:18 +01:00
Dimitri Fontaine
a5c661dd4a
Cleanup error recovery logging.
2014-01-22 17:57:56 +01:00
Dimitri Fontaine
ccb888164c
Fix where to find relative filenames from within commands.
2014-01-22 17:11:01 +01:00
Dimitri Fontaine
c13d7bbae7
Bug fix when processing plain filenames.
2014-01-22 11:00:12 +01:00
Dimitri Fontaine
a51a712b6a
Fix asd dependencies, cleanup useless and misplaced compilation options.
2014-01-21 14:37:26 +01:00
Dimitri Fontaine
6e4a3e2165
Fix parsing COPY error message without column information, see issue #22 .
2014-01-20 17:19:41 +01:00
Dimitri Fontaine
c56bbab0c4
Fix #24 by allowing cast rules adding only transformation functions.
2014-01-20 16:00:09 +01:00
Dimitri Fontaine
e888b15513
Update the docs, we list the default MySQL cast there (see issue #22 ).
2014-01-16 10:10:23 +01:00
Dimitri Fontaine
afc64cc30d
Cast MySQL smallint with auto_increment to PostgreSQL serial, fixes #22 .
2014-01-16 10:07:21 +01:00
Dimitri Fontaine
6431edcd51
Update download page to link to the 3.0.97 binaries.
2014-01-15 23:01:27 +01:00
Dimitri Fontaine
80b6c46aae
Version 3.0.97.
2014-01-15 22:53:43 +01:00
Dimitri Fontaine
aa49e8eec2
Fix the log-filename when operating from the command line.
2014-01-15 22:48:45 +01:00
Dimitri Fontaine
6ccb1871f5
Fix parsing dotted hostnames.
2014-01-15 10:48:56 +01:00
Dimitri Fontaine
07c614c170
Switch to the newer cl-csv API.
...
Thanks to the work at https://github.com/AccelerationNet/cl-csv/pull/12 we
can now use the main branch of cl-csv again.
2014-01-11 18:28:24 +01:00
Dimitri Fontaine
539ad57347
HTML fixes for pgloader.tapoueh.org
2014-01-06 17:01:08 +01:00
Dimitri Fontaine
ad7e3a1b9d
Update copyright information.
2014-01-04 22:38:13 +01:00
Dimitri Fontaine
158b9cd79c
Fix the centos bootstrap script.
2014-01-03 16:49:31 +01:00
Dimitri Fontaine
13d53593b1
Fix buildapp to require some SBCL extensions, fix ASDF setup.
2014-01-03 16:49:08 +01:00
Dimitri Fontaine
2080d91e40
Fix dependency declarations in between files, should help with #19 .
2014-01-02 23:48:57 +01:00
Dimitri Fontaine
d39ff29e3b
Refix #17 by editing away a typo in the instructions.
2014-01-02 23:45:05 +01:00
Dimitri Fontaine
f2a38bdbcd
Typo fix.
2014-01-02 23:40:43 +01:00
Dimitri Fontaine
e86c621fc9
Fix the download page.
2014-01-02 23:33:14 +01:00
Dimitri Fontaine
17b366ca82
Create a website to present the software.
2014-01-02 23:25:23 +01:00
Dimitri Fontaine
b9e584586e
Add RPM packaging for CentOS, with Vagrant provision for this OS.
2013-12-31 17:07:49 +01:00
Dimitri Fontaine
d5890f7779
Release 3.0.96, debian packaging included.
2013-12-27 12:22:03 +01:00
Dimitri Fontaine
ab0bc4ea07
Add some forgotten transformation functions in the docs.
2013-12-26 21:54:14 +01:00
Dimitri Fontaine
f0ec120e2b
Update docs, we now have per-column matching rules and auto_increment matching.
2013-12-26 21:52:25 +01:00
Dimitri Fontaine
7879735046
Back to using Postmaster's main branch, CONTEXT patch applied!
2013-12-26 21:41:16 +01:00
Dimitri Fontaine
ef358c0b7d
Take benefits of PostgreSQL COPY error CONTEXT.
...
This message has the line number where the erroneous data was found on the
server, and given the pre-processing we already done at that point, it's
easy to convert that number into an index into the current batch, an array.
To do do, we need Postmodern to expose the CONTEXT error message and we need
to parse it. The following pull request cares about the Postmodern side of
things:
https://github.com/marijnh/Postmodern/pull/46
The parsing is done as simply as possible, only assuming that the error
message is using comma separators and having the line number in second
position. The parsing as done here should still work with localized message
strings.
CONTEXT: COPY errors, line 3, column b: "2006-13-11"
This change should significantly reduce the cost of error processing.
2013-12-25 21:43:22 +01:00
Dimitri Fontaine
36bfd923fa
Fix monitor logging with no argument is given to the format string.
2013-12-25 21:25:20 +01:00
Dimitri Fontaine
cd1d5ad597
Fix missing *pg-dbname* in CSV processing, resulting in broken logging.
2013-12-25 16:50:14 +01:00
Dimitri Fontaine
7d94d4ff62
Small code cleanup.
2013-12-25 16:20:37 +01:00
Dimitri Fontaine
167407f644
Add a note about performances.
2013-12-25 15:57:38 +01:00
Dimitri Fontaine
6117cde59f
Document batch and retry behaviour.
2013-12-25 15:51:19 +01:00
Dimitri Fontaine
f2bec5fcd1
Fix the main command line "driver" to use the new with-monitor API.
2013-12-24 19:54:22 +01:00
Dimitri Fontaine
43fc540660
Pick a CL encoding name found both in SBCL and CCL for the census test.
2013-12-24 19:37:15 +01:00
Dimitri Fontaine
d6edc54272
Ensure ordering of sections (table-names) in the summary.
2013-12-24 19:31:27 +01:00
Dimitri Fontaine
b2c9e0d2dc
Refactor the whole logging infrastructure not to depend on threads sharing streams.
2013-12-24 19:08:55 +01:00
Dimitri Fontaine
e31c5cbe83
Set the default batch size (in rows) back to 25000.
2013-12-23 13:17:04 +01:00
Dimitri Fontaine
8bf4bffb2c
Fix SQLite stats, wasn't counting read rows.
2013-12-23 13:16:04 +01:00
Dimitri Fontaine
8dda84b0e8
Some more refactoring, MySQL copy-database function is still too big.
2013-12-20 17:37:25 +01:00
