mirrors/pgloader
1
0
Fork 0
mirror of https://github.com/dimitri/pgloader.git synced 2025-08-09 07:47:00 +02:00
Code Issues Projects Releases Wiki Activity
847 Commits 7 Branches 39 Tags 23 MiB
0068a45e1c
Commit Graph

847 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Dimitri Fontaine
bb2c7e4e17 Fix MySQL ENUM and SET parsing, fixing #120. 
MySQL ENUM syntax is more complex than it first looked, allowing for
escaping and spaces, so use a more complex parser here. Fortunately, the
syntax looks like a CSV row enough that cl-csv can be re-used for that.
 2014-10-28 14:56:53 +01:00
Dimitri Fontaine
93990317f3 Rebuild with the new (fixed) dependencies. 2014-10-28 14:56:53 +01:00
Dimitri Fontaine
03b2291332 Rebuild with the new (fixed) dependencies. 2014-10-28 10:51:36 +01:00
Dimitri Fontaine
66f34d823c Merge pull request #121 from 3manuek/master 
Fix INSTALL doc
 2014-10-26 15:02:37 +01:00
Emanuel
9acc716f69 Update INSTALL.md 2014-10-25 12:40:50 -03:00
Emanuel
29ebdff9f9 Update INSTALL.md 
Extending documentation
 2014-10-25 11:55:14 -03:00
Emanuel
b7bea28c9b Fix INSTALL doc 
Added curl on the apt-get install instructions.
 2014-10-25 08:27:16 -03:00
Dimitri Fontaine
68416a79b3 In passing docs review. 
Also modernize the test/census-place.load to use the newer fixed file
format options, and show that in the docs.
 2014-10-18 22:42:31 +02:00
Dimitri Fontaine
1bc467f1a4 TIL how to avoid ignore-errors. 2014-10-16 13:55:46 +02:00
Dimitri Fontaine
22f4317a30 Add support for the CAST rule to SQLite sources. 
This allows users to benefit from the same flexible machinery when using
SQLite as when using MySQL, and also allows to add some more default
cast rules too.
 2014-10-13 00:52:55 +02:00
Dimitri Fontaine
2db4fd89aa Add a sponsors page to the pgloader web site. 2014-10-09 22:52:03 +02:00
Dimitri Fontaine
9288da7c38 Ack the need for better UI in the TODO. 2014-10-09 12:23:53 +02:00
Dimitri Fontaine
f64d242f91 Typo fix. 2014-10-06 13:28:28 +02:00
Dimitri Fontaine
2d2cc26fca Allow setting dynamic space size easily at build time, fix #112. 2014-10-05 22:10:46 +02:00
Dimitri Fontaine
1fa9ed3ea0 Merge pull request #118 from gciolli/master 
Fix oversight in documentation.
 2014-10-02 17:12:02 +02:00
Dimitri Fontaine
b0679ede75 Register the new dependency towards cl-metabang-bind in the debian package. 2014-10-02 17:07:27 +02:00
Dimitri Fontaine
3c334dcdc4 Refactor the main parser to use the bind macro. 
The metabang-bind lib offers a nice bind macro that solves the problem
of ignoring bindings in destructuring-bind, and allows a let* approach
to nested destructuring (wven when mixed with let declarations).

Using that lib (that we already indirectly depend on anyway) simplifies
the parser code substantially.
 2014-10-02 17:05:35 +02:00
Gianni Ciolli
94ebc8967c Fix oversight in documentation. 2014-10-02 16:24:16 +02:00
Dimitri Fontaine
00b002124b Travis: switch test case to timestamp, dropping the TZ. 
The timezone is different in between my own machine and the test system,
just get rid of that discrepancy so that the test stop failing.
 2014-10-02 01:32:19 +02:00
Dimitri Fontaine
08fc7fd092 Square brackets around source field options are now mandatory. 2014-10-02 01:17:24 +02:00
Dimitri Fontaine
2f49c9614c Fix the new test case's out file. 2014-10-02 01:16:58 +02:00
Dimitri Fontaine
aee7eeba8d Fix refactoring missed pieces. 2014-10-02 01:16:04 +02:00
Dimitri Fontaine
7cf7e714fc Implement the source date format option. 2014-10-02 01:03:24 +02:00
Dimitri Fontaine
dfb1e9355a Get rid of our own implementation of alexandria:read-file-into-string. 2014-10-01 23:23:46 +02:00
Dimitri Fontaine
2369a142a7 Refactor source code organisation. 
In passing, fix a bug in the previous commit where left-over code would
cancel the whole new parsing code for advanced source fields options.
 2014-10-01 23:20:24 +02:00
Dimitri Fontaine
ac55d71401 Rework CSV and Fixed files source fields options, see #116. 
It's not possible to use a comma separator when using more than one
source field option at the same time, and for better readability the
options are to be found enclosed in squared brackets.

Also, it's now possible to spell out "from" and "for" keywords on the
source definitions, making it easier to read and maintain the load file,
as in this full example:

          (
           a from  0 for 10,
           b from 10 for  8,
           c from 18 for  8,
           d from 26 for 17 [null if blanks, trim right whitespace]
          )
 2014-10-01 18:32:40 +02:00
Dimitri Fontaine
ea97fc4659 Implement a new source level filter: trim. 
As seen in #116, it might be better for the users to be able to ask for
field trimming right in the source definition, like we do for processing
nulls.
 2014-09-29 15:16:04 +02:00
Dimitri Fontaine
8a0c91fa40 Fix conjunctions for the INCLUDING clause in MySQL. 
We want all table matching any of the given constraints (regexp or
equality search).
 2014-09-23 16:44:38 +02:00
Dimitri Fontaine
128cb4c80a Merge debian packaging fixes, again. 2014-09-23 10:46:36 +02:00
Dimitri Fontaine
a22d4df4b4 Fix debian building where $HOME is read-only. 2014-09-23 10:45:59 +02:00
Dimitri Fontaine
89bc32969a Update pgloader.io download links. 2014-09-22 21:13:48 +02:00
Dimitri Fontaine
2dd39a33e2 Merge debian packaging fixes for 3.1.0. 2014-09-22 21:12:57 +02:00
Dimitri Fontaine
86a3f96d65 Fix debian build on 32 bit systems. 
requiring 4GB of RAM in the lisp image is pushing those poor guys.
 2014-09-22 21:11:03 +02:00
Dimitri Fontaine
52e3371be8 Review default SQLite options. 2014-09-22 14:34:57 +02:00
Dimitri Fontaine
bf1ab9acd7 Document MySQL LOAD default WITH clause options. 2014-09-21 12:26:24 -05:00
Dimitri Fontaine
d4b58a1f78 Review MySQL default options. 
The default values for MySQL WITH clause options wasn't really tested
and broke on simple cases, the new set of defaults is known to work in
many cases (most?).

Other combinations of options will need some review work, and we might
need to consider preventing some of them, that's for another patch tho.
 2014-09-21 12:19:20 -05:00
Dimitri Fontaine
52f4180ccd Clean up debian packaging. 
The licensing of some of the test material being unclear, make a +dfsg
source archive and packages, also clean up several items that shouldn't
be part of the final debian package (.vagrant, etc).

Thanks Christoph Berg for the review!
 2014-09-11 14:22:46 +02:00
Dimitri Fontaine
1acd497a69 Clean the debian package of unclear licensed material. 
In passing, fix the clean target too.
 2014-09-11 14:11:20 +02:00
Dimitri Fontaine
d5b91f99e5 Cleanup the debian packaging. 
And re-add the 2.x era changelog of the package.
 2014-09-11 11:29:13 +02:00
Dimitri Fontaine
968956d8ce Travis: actually we still need our own SBCL backport here. 2014-09-10 23:59:27 +02:00
Dimitri Fontaine
33d9784124 Travis: simplify the build script. 2014-09-10 23:46:50 +02:00
Dimitri Fontaine
8ee3604ddd Travis: non interactive debian dist-upgrade. 2014-09-10 23:35:15 +02:00
Dimitri Fontaine
c4141c464d Now that 3.1.0 is released, we're preparing 3.1.1 here. 2014-09-10 23:03:42 +02:00
Dimitri Fontaine
0a3b4af290 Release pgloader 3.1.0! 2014-09-10 23:02:27 +02:00
Dimitri Fontaine
3d95b089b1 Prepare the RPM release. 2014-09-10 22:40:45 +02:00
Dimitri Fontaine
a516a0dffa Prepare the debian release. 2014-09-10 22:40:31 +02:00
Dimitri Fontaine
0e924fa829 Update the VM setup, use sid to build the debian package. 2014-09-10 22:30:47 +02:00
Dimitri Fontaine
be9abe48fe Cleanup some pgsql connection handling. 2014-09-10 22:20:20 +02:00
Dimitri Fontaine
422f87e912 We don't use the zip system anymore. 2014-09-10 22:19:59 +02:00
Dimitri Fontaine
59afcccfce Fix copy/paste'o in the MySQL howto. 2014-09-10 13:03:38 +02:00