Commit Graph

790 Commits

Author SHA1 Message Date
Dimitri Fontaine
5213456b8f Update SQLite examples in the docs.
We were still using the old "drop tables" syntax...
2014-08-28 10:44:40 +02:00
Dimitri Fontaine
69587b1504 Merge pull request #110 from westonplatter/master
change README wording related to v1, v2, v3
2014-08-27 08:51:28 +02:00
Weston Platter
1c06864452 change README wording related to v1, v2, v3 2014-08-26 13:50:05 -06:00
Dimitri Fontaine
a8bf541568 Merge pull request #108 from lynxis/master
sqlite: convert clob -> text
2014-08-22 21:21:31 +02:00
Alexander Couzens
b8807f52b1 sqlite: convert clob -> text 2014-08-22 20:44:49 +02:00
Dimitri Fontaine
0edb5629b4 Prevent RPM systems from prelinking /usr/bin/pgloader, fix #103. 2014-08-18 11:06:41 +02:00
Dimitri Fontaine
aad272769f Implement MySQL table names filtering in SQL, fix #105.
This allows returning only selected table names as early as possible
rather than post-filtering a possibly large result list.
2014-08-16 16:43:52 +02:00
Dimitri Fontaine
feee770422 Clarify --self-upgrade non-persistent behavior in the README. 2014-08-15 19:56:53 +02:00
Dimitri Fontaine
5d67b0e3a1 TODO: support for tarballs and .gz files has been added in b4ec0ec. 2014-08-11 18:48:13 +02:00
Dimitri Fontaine
2b217a5f8f Merge pull request #104 from nigelzor/fix-quoted-identifiers
Check for reserved keyword after downcasing
2014-08-09 23:20:39 +02:00
Neil Gentleman
16d3edf5be check for reserved keyword after downcasing
uppercase USER isn't reserved, but lowercase is
2014-08-08 18:25:06 -07:00
Dimitri Fontaine
b4ec0ec52f Implement support for gzip and tarball archives format, see #80. 2014-08-06 22:53:51 +02:00
Dimitri Fontaine
68dc8e07b4 When given --summary, refrain from writing to the terminal, fixing #102. 2014-08-03 22:56:24 +02:00
Dimitri Fontaine
1179f449dc Remove outdated comments about the reader and writer batches... 2014-08-03 19:49:10 +02:00
Dimitri Fontaine
624077bb95 Count bytes only once when under memory watch. 2014-08-03 19:48:49 +02:00
Dimitri Fontaine
ca52ddacb1 SQLite: transform "0" timestamps to NULL, see #100. 2014-07-30 18:42:49 +02:00
Dimitri Fontaine
ed8022ce64 SQLite: transform default values to their PostgreSQL representation.
When default values are used in SQLite they are of course using their
SQLite representation, which might not be compatible with the PostgreSQL
target data type we're casting to. Make it so that the default values
are transformed too, as we already do in the MySQL case.

See #100.
2014-07-30 16:32:35 +02:00
Dimitri Fontaine
a621a48c04 Fix including/excluding options parsing for SQLite, fix #99 (again). 2014-07-27 14:13:54 +02:00
Dimitri Fontaine
79f622234f Allow specifying the SQLite text encoding, fix #99. 2014-07-25 19:01:15 +02:00
Dimitri Fontaine
43fd3ba6ff In passing docs formating fix. 2014-07-25 18:59:45 +02:00
Dimitri Fontaine
b538539fb3 Handle errors when processing data from SQLite.
Some errors could be related to encoding issues, as in #99.
2014-07-25 18:40:46 +02:00
Dimitri Fontaine
de910321ff Commit the formated manpage, see #98. 2014-07-24 19:05:01 +02:00
Dimitri Fontaine
6e324a1f74 Merge pull request #98 from cbbrowne/master
Some wordsmithing on the docs
2014-07-24 19:04:09 +02:00
Dimitri Fontaine
368dd88b48 Implement GETENV facility for reading FROM and INTO clauses.
It might be important to be able to use the exact same pgloader commands
file but adapt its source and target depending on the environment where
the command is to be run (production, development, staging, etc).

Introduce the new sub-clause GETENV 'variable-name' to that effect.

The regression test facility that we have now isn't nearly sophisticated
enough to support this, so the feature isn't yet covered.
2014-07-24 18:28:59 +02:00
Christopher Browne
ccb22d410b more wordsmithing 2014-07-24 11:03:33 -04:00
Dimitri Fontaine
798ae1e1a8 Remove MATERIALIZE ALL VIEWS from the TODO, it's been done. 2014-07-24 16:28:16 +02:00
Christopher Browne
f0ea64d627 Wordsmithing; fixing typos and such 2014-07-23 18:34:51 -04:00
Dimitri Fontaine
3b2119cae4 Don't catch all and any errors for retrying batches.
In particular a non existing table or column shouldn't be considered as
an error we can just retry upon receiving.
2014-07-21 15:38:53 +02:00
Dimitri Fontaine
a090f2fe3d Fix CCL compat where nil can't be a plist key. 2014-07-18 12:49:14 +02:00
Dimitri Fontaine
4aa8b0946f Get rid of unused sample file. 2014-07-18 11:07:25 +02:00
Dimitri Fontaine
cb4b2a3334 Convert SQLite tinyint to PostgreSQL smallint, fixes #97. 2014-07-18 11:06:37 +02:00
Dimitri Fontaine
9eff1bb4d8 Travis: Adapt test/ixf.load to work against 9.1. 2014-07-17 17:35:41 +02:00
Dimitri Fontaine
ebef038c8f Document the LOAD FROM IXF command. 2014-07-17 16:59:12 +02:00
Dimitri Fontaine
5a2b98856f Update the main SQLite test database. 2014-07-17 16:56:28 +02:00
Dimitri Fontaine
07b5aa3ed6 Add BEFORE/AFTER LOAD clauses to IXF and DBF commands. 2014-07-17 16:56:13 +02:00
Dimitri Fontaine
f352b39284 Travis: quickload local pgloader, not the QL dist one... 2014-07-17 10:19:00 +02:00
Dimitri Fontaine
e4948a3627 Move some logic up to the parser.
As per grammar review at  https://github.com/nikodemus/esrap/issues/26,
improve the situation.
2014-07-16 23:25:46 +02:00
Dimitri Fontaine
0f3103da2d Improve the parsing rules, avoiding eating all possible chars.
Help improving the situation for #56.
2014-07-16 23:09:11 +02:00
Dimitri Fontaine
5a636522de Fix make dependencies. 2014-07-14 22:34:43 +02:00
Dimitri Fontaine
9ddf117a90 In-passing desultory cleanup. 2014-07-14 21:54:50 +02:00
Dimitri Fontaine
3e0526c957 Implement early support for IXF files. 2014-07-14 21:53:50 +02:00
Dimitri Fontaine
f86dcf86fb Fix download link for latest tarball. 2014-07-14 14:34:26 +02:00
Dimitri Fontaine
d00837f8fc Fix --upgrade-config basic usage. 2014-07-13 16:35:53 +02:00
Dimitri Fontaine
f5fc5cce73 Review MySQL casts rules with auto_increment, fix #96. 2014-07-12 22:41:20 +02:00
Dimitri Fontaine
53a7e47058 New MySQL default Cast Rule for bit(1) to boolean, fix #93.
We need a new transformation function that work with a vector of
integers as input.
2014-07-03 11:47:59 +02:00
Dimitri Fontaine
6d49d9e10a Add a "real" column test case in SQLite main test, Closes #73. 2014-06-29 16:33:42 +02:00
Dimitri Fontaine
55655ed927 Fix fixed-file column name quoting, as we did for CSV, fixes #70. 2014-06-29 16:25:30 +02:00
Dimitri Fontaine
6a7f3c2417 Add some docs about oversized batches, fix #86. 2014-06-29 16:06:09 +02:00
Dimitri Fontaine
2577308ad6 Ensure field level processing is happening in all cases.
When using both field level specifications and transformation functions,
the transformation needs to happen on the result of the field processing
rather than on the raw field.

Fixes #92.
2014-06-26 02:08:49 +02:00
Dimitri Fontaine
ab75e6c626 Improve ragged right code comments, follow-up to #90. 2014-06-25 13:29:26 +02:00