Commit Graph

790 Commits

Author SHA1 Message Date
Dimitri Fontaine
d39ff29e3b Refix #17 by editing away a typo in the instructions. 2014-01-02 23:45:05 +01:00
Dimitri Fontaine
f2a38bdbcd Typo fix. 2014-01-02 23:40:43 +01:00
Dimitri Fontaine
e86c621fc9 Fix the download page. 2014-01-02 23:33:14 +01:00
Dimitri Fontaine
17b366ca82 Create a website to present the software. 2014-01-02 23:25:23 +01:00
Dimitri Fontaine
b9e584586e Add RPM packaging for CentOS, with Vagrant provision for this OS. 2013-12-31 17:07:49 +01:00
Dimitri Fontaine
d5890f7779 Release 3.0.96, debian packaging included. 2013-12-27 12:22:03 +01:00
Dimitri Fontaine
ab0bc4ea07 Add some forgotten transformation functions in the docs. 2013-12-26 21:54:14 +01:00
Dimitri Fontaine
f0ec120e2b Update docs, we now have per-column matching rules and auto_increment matching. 2013-12-26 21:52:25 +01:00
Dimitri Fontaine
7879735046 Back to using Postmaster's main branch, CONTEXT patch applied! 2013-12-26 21:41:16 +01:00
Dimitri Fontaine
ef358c0b7d Take benefits of PostgreSQL COPY error CONTEXT.
This message has the line number where the erroneous data was found on the
server, and given the pre-processing we already done at that point, it's
easy to convert that number into an index into the current batch, an array.

To do do, we need Postmodern to expose the CONTEXT error message and we need
to parse it. The following pull request cares about the Postmodern side of
things:

  https://github.com/marijnh/Postmodern/pull/46

The parsing is done as simply as possible, only assuming that the error
message is using comma separators and having the line number in second
position. The parsing as done here should still work with localized message
strings.

  CONTEXT: COPY errors, line 3, column b: "2006-13-11"

This change should significantly reduce the cost of error processing.
2013-12-25 21:43:22 +01:00
Dimitri Fontaine
36bfd923fa Fix monitor logging with no argument is given to the format string. 2013-12-25 21:25:20 +01:00
Dimitri Fontaine
cd1d5ad597 Fix missing *pg-dbname* in CSV processing, resulting in broken logging. 2013-12-25 16:50:14 +01:00
Dimitri Fontaine
7d94d4ff62 Small code cleanup. 2013-12-25 16:20:37 +01:00
Dimitri Fontaine
167407f644 Add a note about performances. 2013-12-25 15:57:38 +01:00
Dimitri Fontaine
6117cde59f Document batch and retry behaviour. 2013-12-25 15:51:19 +01:00
Dimitri Fontaine
f2bec5fcd1 Fix the main command line "driver" to use the new with-monitor API. 2013-12-24 19:54:22 +01:00
Dimitri Fontaine
43fc540660 Pick a CL encoding name found both in SBCL and CCL for the census test. 2013-12-24 19:37:15 +01:00
Dimitri Fontaine
d6edc54272 Ensure ordering of sections (table-names) in the summary. 2013-12-24 19:31:27 +01:00
Dimitri Fontaine
b2c9e0d2dc Refactor the whole logging infrastructure not to depend on threads sharing streams. 2013-12-24 19:08:55 +01:00
Dimitri Fontaine
e31c5cbe83 Set the default batch size (in rows) back to 25000. 2013-12-23 13:17:04 +01:00
Dimitri Fontaine
8bf4bffb2c Fix SQLite stats, wasn't counting read rows. 2013-12-23 13:16:04 +01:00
Dimitri Fontaine
8dda84b0e8 Some more refactoring, MySQL copy-database function is still too big. 2013-12-20 17:37:25 +01:00
Dimitri Fontaine
fe302af221 Refactor the dbname API to feed from the connection string directly. 2013-12-20 17:24:02 +01:00
Dimitri Fontaine
5a464a0fae Remove some dead code (was intended for later use). 2013-12-20 17:07:43 +01:00
Dimitri Fontaine
4748104a38 Refactor the too big copy-database function for MySQL. 2013-12-20 15:06:40 +01:00
Dimitri Fontaine
aa934f1a5c Review, fix some comments and indenting. 2013-12-20 11:08:26 +01:00
Dimitri Fontaine
49f2567b0d Improve stats on meta-data and before sections. 2013-12-20 10:50:27 +01:00
Dimitri Fontaine
ce14542a15 Respect the Materialize Views ordering given in the command when loading data. 2013-12-20 10:35:00 +01:00
Dimitri Fontaine
bb561a0c4d Fetch all MySQL meta-data from a single connection. 2013-12-20 10:21:31 +01:00
Dimitri Fontaine
e09eb3fbb2 There is always a need for a before state when migrating from MySQL... 2013-12-20 10:19:36 +01:00
Dimitri Fontaine
aca04b1514 Fix problem found when trying to load the code with CCL. 2013-12-19 23:08:02 +01:00
Dimitri Fontaine
d2e9f9f400 Update debian packaging for 3.0.95. 2013-12-18 23:34:17 +01:00
Dimitri Fontaine
3a5d618cc8 Switch to using vectors for representing rows, minimize consing. 2013-12-18 23:30:11 +01:00
Dimitri Fontaine
0a6608061c Due to the bug fixed and the new batch implementation, version is now 3.0.95. 2013-12-18 18:56:12 +01:00
Dimitri Fontaine
82c4bc9e9e Switch the pgsql batch implementation to using arrays to reduce consing. 2013-12-18 18:31:06 +01:00
Dimitri Fontaine
fe2fb517ac Typo fix. 2013-12-18 18:26:31 +01:00
Dimitri Fontaine
f51fed84b5 Review the installation docs, fix #17. 2013-12-18 15:16:36 +01:00
Dimitri Fontaine
772a12d522 Postmodern and ABNF quicklisp version are now ok for use in pgloader. 2013-12-18 15:13:31 +01:00
Dimitri Fontaine
bcb058d9ba Merge pull request #18 from Sectoid/fix-mysql-quoting
Fixing "quote identifiers" option for MySQL conversions
2013-12-18 06:01:08 -08:00
Gleb Golubitsky
50e8fca96b Fixing "quote identifiers" option for MySQL conversions
Signed-off-by: Gleb Golubitsky <sectoid@gnolltech.org>
2013-12-18 15:06:22 +02:00
Dimitri Fontaine
1ef024c5c7 Fix handling of reserved table names in SELECT and COPY commands. 2013-12-18 12:06:41 +01:00
Dimitri Fontaine
633b6ae64f Export with-mysql-connection facility for REPL testing. 2013-12-18 12:05:56 +01:00
Dimitri Fontaine
d44baed8c3 Desultory cleaning of the debian packaging. 2013-12-09 16:07:10 +01:00
Dimitri Fontaine
f58b5960cd Prepare a debian package, and make it pgloader 3.0.94. 2013-12-09 13:04:29 +01:00
Dimitri Fontaine
477a52a6d3 Thanks to Qmynd, no need for the IS NULL query dance anymore. 2013-12-09 11:23:00 +01:00
Dimitri Fontaine
47d8e0af1c The qmynd (MySQL driver) changes made it upstream. 2013-12-06 18:35:15 +01:00
Dimitri Fontaine
b84541367d Add MySQL (MariaDB) support in tests. 2013-12-03 22:06:10 +01:00
Dimitri Fontaine
f02eb641b4 Switch from cl-mysql to qmynd, an all-lisp driver for MySQL. 2013-12-03 22:05:39 +01:00
Dimitri Fontaine
157587476b Call it version 3.0.93 now that we did fix many bugs. 2013-11-26 16:59:44 +01:00
Dimitri Fontaine
f79ca95887 Add some documentation about the new MATCHING clause implementation. 2013-11-26 16:53:37 +01:00