mirrors/pgloader
1
0
Fork 0
mirror of https://github.com/dimitri/pgloader.git synced 2025-08-13 01:37:00 +02:00
Code Issues Projects Releases Wiki Activity
814 Commits 7 Branches 39 Tags 23 MiB
894df76b36
Commit Graph

814 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Dimitri Fontaine
fff756f95f Refactor the command parser. 
Split its content into separate files, so that each is easier to
maintain, and to make it easier also to add support for new sources.
 2014-11-16 22:22:04 +01:00
Dimitri Fontaine
c94164c05c Fix MS SQL convertion of money to numeric. 2014-11-16 21:54:13 +01:00
Dimitri Fontaine
87e2e16582 Implement data transfer from SQL Server. 2014-11-10 03:15:22 +01:00
Dimitri Fontaine
e2f6dba107 Force package names to be read in the KEYWORD package. 2014-11-10 01:17:06 +01:00
Dimitri Fontaine
03bba5f486 Some more SQL Server support (schema conversion). 
Converting the table definitions (with type casting) seems to work. Also
did experiment a little with actuallt fetching some data... and had to
edit the cl-mssql driver, which is temporarily monkey patched.
 2014-11-10 01:16:10 +01:00
Dimitri Fontaine
ca325ba799 Refactor the SQLite source files. 2014-11-09 22:59:30 +01:00
Dimitri Fontaine
5bc5a52582 Some more initial steps towards MS SQL support. 2014-11-09 22:30:02 +01:00
Dimitri Fontaine
6473a892d4 First steps toward MS SQL compatibility. 2014-11-09 00:09:42 +01:00
Dimitri Fontaine
4c87ece82a Add a pgloader.exe binary to the download page! 2014-11-06 23:08:32 +01:00
Dimitri Fontaine
ed853a7bea Allow pgloader to work on windows. 2014-11-06 22:12:20 +01:00
Dimitri Fontaine
3904e9f058 Typo fix. 2014-11-05 16:42:10 +01:00
Dimitri Fontaine
a5e9cb172c Follow-up to the merge, we're not a release branch. 2014-11-05 16:41:19 +01:00
Dimitri Fontaine
fc78c1f623 Update web/download with the new release. 2014-11-05 16:38:24 +01:00
Dimitri Fontaine
8f1fc2a7a6 Release version 3.1.1. 2014-11-05 16:20:14 +01:00
Dimitri Fontaine
9ce323007e Report the summary to *standard-output*. 
There's actually no reason to insist on using the *terminal-io*
directly, that is the pty device.
 2014-11-04 02:05:19 +01:00
Dimitri Fontaine
da70aaf481 Merge debian bugfix. 2014-11-03 14:15:11 +01:00
Dimitri Fontaine
4916e67a9e Fix --root-dir debian reported bug #767288 2014-11-03 14:08:51 +01:00
Dimitri Fontaine
bb2c7e4e17 Fix MySQL ENUM and SET parsing, fixing #120. 
MySQL ENUM syntax is more complex than it first looked, allowing for
escaping and spaces, so use a more complex parser here. Fortunately, the
syntax looks like a CSV row enough that cl-csv can be re-used for that.
 2014-10-28 14:56:53 +01:00
Dimitri Fontaine
93990317f3 Rebuild with the new (fixed) dependencies. 2014-10-28 14:56:53 +01:00
Dimitri Fontaine
03b2291332 Rebuild with the new (fixed) dependencies. 2014-10-28 10:51:36 +01:00
Dimitri Fontaine
66f34d823c Merge pull request #121 from 3manuek/master 
Fix INSTALL doc
 2014-10-26 15:02:37 +01:00
Emanuel
9acc716f69 Update INSTALL.md 2014-10-25 12:40:50 -03:00
Emanuel
29ebdff9f9 Update INSTALL.md 
Extending documentation
 2014-10-25 11:55:14 -03:00
Emanuel
b7bea28c9b Fix INSTALL doc 
Added curl on the apt-get install instructions.
 2014-10-25 08:27:16 -03:00
Dimitri Fontaine
68416a79b3 In passing docs review. 
Also modernize the test/census-place.load to use the newer fixed file
format options, and show that in the docs.
 2014-10-18 22:42:31 +02:00
Dimitri Fontaine
1bc467f1a4 TIL how to avoid ignore-errors. 2014-10-16 13:55:46 +02:00
Dimitri Fontaine
22f4317a30 Add support for the CAST rule to SQLite sources. 
This allows users to benefit from the same flexible machinery when using
SQLite as when using MySQL, and also allows to add some more default
cast rules too.
 2014-10-13 00:52:55 +02:00
Dimitri Fontaine
2db4fd89aa Add a sponsors page to the pgloader web site. 2014-10-09 22:52:03 +02:00
Dimitri Fontaine
9288da7c38 Ack the need for better UI in the TODO. 2014-10-09 12:23:53 +02:00
Dimitri Fontaine
f64d242f91 Typo fix. 2014-10-06 13:28:28 +02:00
Dimitri Fontaine
2d2cc26fca Allow setting dynamic space size easily at build time, fix #112. 2014-10-05 22:10:46 +02:00
Dimitri Fontaine
1fa9ed3ea0 Merge pull request #118 from gciolli/master 
Fix oversight in documentation.
 2014-10-02 17:12:02 +02:00
Dimitri Fontaine
b0679ede75 Register the new dependency towards cl-metabang-bind in the debian package. 2014-10-02 17:07:27 +02:00
Dimitri Fontaine
3c334dcdc4 Refactor the main parser to use the bind macro. 
The metabang-bind lib offers a nice bind macro that solves the problem
of ignoring bindings in destructuring-bind, and allows a let* approach
to nested destructuring (wven when mixed with let declarations).

Using that lib (that we already indirectly depend on anyway) simplifies
the parser code substantially.
 2014-10-02 17:05:35 +02:00
Gianni Ciolli
94ebc8967c Fix oversight in documentation. 2014-10-02 16:24:16 +02:00
Dimitri Fontaine
00b002124b Travis: switch test case to timestamp, dropping the TZ. 
The timezone is different in between my own machine and the test system,
just get rid of that discrepancy so that the test stop failing.
 2014-10-02 01:32:19 +02:00
Dimitri Fontaine
08fc7fd092 Square brackets around source field options are now mandatory. 2014-10-02 01:17:24 +02:00
Dimitri Fontaine
2f49c9614c Fix the new test case's out file. 2014-10-02 01:16:58 +02:00
Dimitri Fontaine
aee7eeba8d Fix refactoring missed pieces. 2014-10-02 01:16:04 +02:00
Dimitri Fontaine
7cf7e714fc Implement the source date format option. 2014-10-02 01:03:24 +02:00
Dimitri Fontaine
dfb1e9355a Get rid of our own implementation of alexandria:read-file-into-string. 2014-10-01 23:23:46 +02:00
Dimitri Fontaine
2369a142a7 Refactor source code organisation. 
In passing, fix a bug in the previous commit where left-over code would
cancel the whole new parsing code for advanced source fields options.
 2014-10-01 23:20:24 +02:00
Dimitri Fontaine
ac55d71401 Rework CSV and Fixed files source fields options, see #116. 
It's not possible to use a comma separator when using more than one
source field option at the same time, and for better readability the
options are to be found enclosed in squared brackets.

Also, it's now possible to spell out "from" and "for" keywords on the
source definitions, making it easier to read and maintain the load file,
as in this full example:

          (
           a from  0 for 10,
           b from 10 for  8,
           c from 18 for  8,
           d from 26 for 17 [null if blanks, trim right whitespace]
          )
 2014-10-01 18:32:40 +02:00
Dimitri Fontaine
ea97fc4659 Implement a new source level filter: trim. 
As seen in #116, it might be better for the users to be able to ask for
field trimming right in the source definition, like we do for processing
nulls.
 2014-09-29 15:16:04 +02:00
Dimitri Fontaine
8a0c91fa40 Fix conjunctions for the INCLUDING clause in MySQL. 
We want all table matching any of the given constraints (regexp or
equality search).
 2014-09-23 16:44:38 +02:00
Dimitri Fontaine
128cb4c80a Merge debian packaging fixes, again. 2014-09-23 10:46:36 +02:00
Dimitri Fontaine
a22d4df4b4 Fix debian building where $HOME is read-only. 2014-09-23 10:45:59 +02:00
Dimitri Fontaine
89bc32969a Update pgloader.io download links. 2014-09-22 21:13:48 +02:00
Dimitri Fontaine
2dd39a33e2 Merge debian packaging fixes for 3.1.0. 2014-09-22 21:12:57 +02:00
Dimitri Fontaine
86a3f96d65 Fix debian build on 32 bit systems. 
requiring 4GB of RAM in the lisp image is pushing those poor guys.
 2014-09-22 21:11:03 +02:00