Dimitri Fontaine
6ccb1871f5
Fix parsing dotted hostnames.
2014-01-15 10:48:56 +01:00
Dimitri Fontaine
07c614c170
Switch to the newer cl-csv API.
...
Thanks to the work at https://github.com/AccelerationNet/cl-csv/pull/12 we
can now use the main branch of cl-csv again.
2014-01-11 18:28:24 +01:00
Dimitri Fontaine
539ad57347
HTML fixes for pgloader.tapoueh.org
2014-01-06 17:01:08 +01:00
Dimitri Fontaine
ad7e3a1b9d
Update copyright information.
2014-01-04 22:38:13 +01:00
Dimitri Fontaine
158b9cd79c
Fix the centos bootstrap script.
2014-01-03 16:49:31 +01:00
Dimitri Fontaine
13d53593b1
Fix buildapp to require some SBCL extensions, fix ASDF setup.
2014-01-03 16:49:08 +01:00
Dimitri Fontaine
2080d91e40
Fix dependency declarations in between files, should help with #19 .
2014-01-02 23:48:57 +01:00
Dimitri Fontaine
d39ff29e3b
Refix #17 by editing away a typo in the instructions.
2014-01-02 23:45:05 +01:00
Dimitri Fontaine
f2a38bdbcd
Typo fix.
2014-01-02 23:40:43 +01:00
Dimitri Fontaine
e86c621fc9
Fix the download page.
2014-01-02 23:33:14 +01:00
Dimitri Fontaine
17b366ca82
Create a website to present the software.
2014-01-02 23:25:23 +01:00
Dimitri Fontaine
b9e584586e
Add RPM packaging for CentOS, with Vagrant provision for this OS.
2013-12-31 17:07:49 +01:00
Dimitri Fontaine
d5890f7779
Release 3.0.96, debian packaging included.
2013-12-27 12:22:03 +01:00
Dimitri Fontaine
ab0bc4ea07
Add some forgotten transformation functions in the docs.
2013-12-26 21:54:14 +01:00
Dimitri Fontaine
f0ec120e2b
Update docs, we now have per-column matching rules and auto_increment matching.
2013-12-26 21:52:25 +01:00
Dimitri Fontaine
7879735046
Back to using Postmaster's main branch, CONTEXT patch applied!
2013-12-26 21:41:16 +01:00
Dimitri Fontaine
ef358c0b7d
Take benefits of PostgreSQL COPY error CONTEXT.
...
This message has the line number where the erroneous data was found on the
server, and given the pre-processing we already done at that point, it's
easy to convert that number into an index into the current batch, an array.
To do do, we need Postmodern to expose the CONTEXT error message and we need
to parse it. The following pull request cares about the Postmodern side of
things:
https://github.com/marijnh/Postmodern/pull/46
The parsing is done as simply as possible, only assuming that the error
message is using comma separators and having the line number in second
position. The parsing as done here should still work with localized message
strings.
CONTEXT: COPY errors, line 3, column b: "2006-13-11"
This change should significantly reduce the cost of error processing.
2013-12-25 21:43:22 +01:00
Dimitri Fontaine
36bfd923fa
Fix monitor logging with no argument is given to the format string.
2013-12-25 21:25:20 +01:00
Dimitri Fontaine
cd1d5ad597
Fix missing *pg-dbname* in CSV processing, resulting in broken logging.
2013-12-25 16:50:14 +01:00
Dimitri Fontaine
7d94d4ff62
Small code cleanup.
2013-12-25 16:20:37 +01:00
Dimitri Fontaine
167407f644
Add a note about performances.
2013-12-25 15:57:38 +01:00
Dimitri Fontaine
6117cde59f
Document batch and retry behaviour.
2013-12-25 15:51:19 +01:00
Dimitri Fontaine
f2bec5fcd1
Fix the main command line "driver" to use the new with-monitor API.
2013-12-24 19:54:22 +01:00
Dimitri Fontaine
43fc540660
Pick a CL encoding name found both in SBCL and CCL for the census test.
2013-12-24 19:37:15 +01:00
Dimitri Fontaine
d6edc54272
Ensure ordering of sections (table-names) in the summary.
2013-12-24 19:31:27 +01:00
Dimitri Fontaine
b2c9e0d2dc
Refactor the whole logging infrastructure not to depend on threads sharing streams.
2013-12-24 19:08:55 +01:00
Dimitri Fontaine
e31c5cbe83
Set the default batch size (in rows) back to 25000.
2013-12-23 13:17:04 +01:00
Dimitri Fontaine
8bf4bffb2c
Fix SQLite stats, wasn't counting read rows.
2013-12-23 13:16:04 +01:00
Dimitri Fontaine
8dda84b0e8
Some more refactoring, MySQL copy-database function is still too big.
2013-12-20 17:37:25 +01:00
Dimitri Fontaine
fe302af221
Refactor the dbname API to feed from the connection string directly.
2013-12-20 17:24:02 +01:00
Dimitri Fontaine
5a464a0fae
Remove some dead code (was intended for later use).
2013-12-20 17:07:43 +01:00
Dimitri Fontaine
4748104a38
Refactor the too big copy-database function for MySQL.
2013-12-20 15:06:40 +01:00
Dimitri Fontaine
aa934f1a5c
Review, fix some comments and indenting.
2013-12-20 11:08:26 +01:00
Dimitri Fontaine
49f2567b0d
Improve stats on meta-data and before sections.
2013-12-20 10:50:27 +01:00
Dimitri Fontaine
ce14542a15
Respect the Materialize Views ordering given in the command when loading data.
2013-12-20 10:35:00 +01:00
Dimitri Fontaine
bb561a0c4d
Fetch all MySQL meta-data from a single connection.
2013-12-20 10:21:31 +01:00
Dimitri Fontaine
e09eb3fbb2
There is always a need for a before state when migrating from MySQL...
2013-12-20 10:19:36 +01:00
Dimitri Fontaine
aca04b1514
Fix problem found when trying to load the code with CCL.
2013-12-19 23:08:02 +01:00
Dimitri Fontaine
d2e9f9f400
Update debian packaging for 3.0.95.
2013-12-18 23:34:17 +01:00
Dimitri Fontaine
3a5d618cc8
Switch to using vectors for representing rows, minimize consing.
2013-12-18 23:30:11 +01:00
Dimitri Fontaine
0a6608061c
Due to the bug fixed and the new batch implementation, version is now 3.0.95.
2013-12-18 18:56:12 +01:00
Dimitri Fontaine
82c4bc9e9e
Switch the pgsql batch implementation to using arrays to reduce consing.
2013-12-18 18:31:06 +01:00
Dimitri Fontaine
fe2fb517ac
Typo fix.
2013-12-18 18:26:31 +01:00
Dimitri Fontaine
f51fed84b5
Review the installation docs, fix #17 .
2013-12-18 15:16:36 +01:00
Dimitri Fontaine
772a12d522
Postmodern and ABNF quicklisp version are now ok for use in pgloader.
2013-12-18 15:13:31 +01:00
Dimitri Fontaine
bcb058d9ba
Merge pull request #18 from Sectoid/fix-mysql-quoting
...
Fixing "quote identifiers" option for MySQL conversions
2013-12-18 06:01:08 -08:00
Gleb Golubitsky
50e8fca96b
Fixing "quote identifiers" option for MySQL conversions
...
Signed-off-by: Gleb Golubitsky <sectoid@gnolltech.org>
2013-12-18 15:06:22 +02:00
Dimitri Fontaine
1ef024c5c7
Fix handling of reserved table names in SELECT and COPY commands.
2013-12-18 12:06:41 +01:00
Dimitri Fontaine
633b6ae64f
Export with-mysql-connection facility for REPL testing.
2013-12-18 12:05:56 +01:00
Dimitri Fontaine
d44baed8c3
Desultory cleaning of the debian packaging.
2013-12-09 16:07:10 +01:00
