Commit Graph

1654 Commits

Author SHA1 Message Date
Dimitri Fontaine
2af1a31be4
Accept that sometimes the Postgres source connection has a nil variant.
In that case we behave the same as when the variant is known to be :pgdg.
The only other supported variant at this time being :redshift, that should
be okay.
2022-08-19 16:55:05 +02:00
Dimitri Fontaine
75c00b5ff4
Use the unix-namestring as the hash key for SQL queries. (#1420)
The way we manage and then fetch the SQL queries embedded in the pgloader
binary we should really take the unix-namestring rather than the
native-namestring. Of course, this only matters when the host OS is NOT
unix, which is why this bug existed for so long.
2022-08-18 14:16:58 +02:00
Dimitri Fontaine
696617d930
Upgrade Clozure-CL in the Dockerfile.ccl. 2022-08-18 14:01:03 +02:00
Christoph Berg
755b55d2b3 New upstream version 2022-08-13 10:35:39 +02:00
Christoph Berg
b24eba972d Set SBCL dynamic space size to 16 GB on 64 bit architectures. 2022-08-12 22:57:51 +02:00
Dimitri Fontaine
28ef36a6dc
README and install docs improvements. 2022-08-12 17:32:55 +02:00
Dimitri Fontaine
5f5734cf01
Update current version number, latest release being 3.6.6. 2022-08-12 17:23:14 +02:00
Dimitri Fontaine
ff33ec5e2e
Improve README and add proper INSTALL docs. (#1417) 2022-08-12 17:10:34 +02:00
Dimitri Fontaine
fac03a68d4
Install a github action to publish docker images. (#1416)
* Install a github action to publish docker images.

* Our main branch name is still "master".
2022-08-12 16:39:05 +02:00
Dimitri Fontaine
8d97a313fa
Improve documentation with command lines and defaults. (#1415)
* Improve documentation with command lines and defaults.

The advanced documentation coverage skipped the simple approach and didn't
explain fully what to do with the sample commands.

Fixes #1413.

* Fix docs indentation in the MySQL connection string options.

* Desultory docs and docs config fixes.
2022-08-12 15:27:40 +02:00
Dimitri Fontaine
eeefcaa98e
SBCL compiler notes should not be fatal to pgloader. (#1411)
* SBCL compiler notes should not be fatal to pgloader.

The compile function returns warnings-p and failure-p values, use that to
decide if the code could be compiled, and only signal a condition when it
has been fatal to compiling the code at run-time.

The SBCL compiler is getting smarter at removing unreachable code, and it
looks like pgloader is producing some unreachable code from parsing the user
provided commands.

* Let's make the code look like actual lisp code now.

* Another fix.

* Improve condition handling and simplify processing of compile values.

We don't need to react to any condition signaled from inside pgloader, only
to errors and serious-conditions (an error is a serious-condition). With
that, we can just ignore the compiler warnings and style notes.

* Fix the handler-bind to only consider serious-conditions too.

* Capture compiler output as log it as a debug level message.

* Fix previous attempt.

* Improve capturing of the compiler output (include summary).

* Actually call the new compile function in all places.

Co-authored-by: Dimitri Fontaine <dimitri@citusdata.com>
2022-08-11 17:06:27 +02:00
Christoph Berg
2c52da12cb Sync version numbers 2022-06-27 11:03:22 +02:00
Christoph Berg
b890b32cc1 releasing package pgloader version 3.6.5-1 2022-06-27 10:25:28 +02:00
Christoph Berg
10ee9d931a Remove regression output on clean 2022-06-26 23:32:55 +02:00
Christoph Berg
7c0d478064 Debian: Run tests at build-time as well. 2022-06-26 23:31:54 +02:00
Christoph Berg
05282173d4 bootstrap-centos.sh: Bump sbcl version to 2.2.5
Close #956
2022-06-24 16:28:51 +02:00
Christoph Berg
12d4885f3d Remove bundle files on clean 2022-06-24 16:22:00 +02:00
Christoph Berg
a56f5a4b25 Build bundle file
Close #1347
2022-06-24 16:17:29 +02:00
Christoph Berg
f667fcc666 debian/watch: Look at tags instead of releases 2022-06-24 15:12:05 +02:00
Christoph Berg
3f1ca18229 New upstream version 3.6.4 2022-06-24 14:39:50 +02:00
Vincent GRAILLOT
55d76af6c9 Fix documentation typo
CSV Source Specification: From
One of special values are `FILENAME MATCHING` and not `FILENAMES MATCHING`
2022-06-24 14:13:20 +02:00
Christoph Berg
ebad5e2e57 debian/tests/testsuite: Use trust authentication 2022-06-24 13:21:29 +02:00
Christoph Berg
e19329be99 debian/tests/testsuite: Use installed pgloader binary 2022-06-24 10:47:29 +02:00
Christoph Berg
4eb618d45f .github/workflows/debian-ci.yml: We are not on focal, drop special rule 2022-06-24 10:45:49 +02:00
Christoph Berg
9c904b67d1 debian/tests/testsuite: Run "regress" instead of "all" 2022-06-24 10:41:14 +02:00
Christoph Berg
e234ff188e test: Create csv schema in partial.load 2022-06-24 10:39:15 +02:00
Dimitri Fontaine
e2418891a4
Fix looping over sbcl *external-formats*.
The internal represtation of the SBCL *external-formats* has changed to a
new structure which is not an hash-table anymore.
2022-06-23 17:15:47 +02:00
Christoph Berg
3853c8996f test: Depend on postgresql-14-ip4r 2022-06-23 16:25:55 +02:00
Christoph Berg
087ddce749 Run testsuite 2022-06-23 16:20:14 +02:00
Christoph Berg
b54ed07175 Ignore some Debian build artifacts 2022-06-23 16:08:36 +02:00
Christoph Berg
8451ca5158 test: Don't run sakila test by default; set variables for tests
Sakila needs a MySQL database running. Set DBPATH and SOURCEFILE for the
sqlite-env.load and csv-districts-env.out tests.
2022-06-23 15:59:11 +02:00
Brendan Ball
4114daf190 parameterize DYNSIZE in dockerfiles 2022-06-23 14:20:38 +02:00
Christoph Berg
85f2d3e55b Add Debian autopkgtest 2022-06-23 14:11:37 +02:00
Christoph Berg
71c922f0dd Remove docker-ci workflow
It was never properly hooked up.
2022-06-23 13:51:04 +02:00
Darryl T. Agostinelli
c9616e2675 specify v8 of freetds to deal with #1068 'MSSQL to Postgres: is not of type VECTOR' 2022-06-23 13:48:34 +02:00
Scott Thomas
7e1f7c51c8 Allow underscores in cast type names
Underscores might exist in cast type names, for example if the type being cast is an enum (which can have arbitrary names).

Fixes #1378
2022-06-23 13:43:21 +02:00
Joakim Soderlund
6de6457d65 Fix minor casing issue in intro docs 2022-06-23 13:33:51 +02:00
Athos Ribeiro
248c2f709a Force libcrypto reload in src/hooks.lisp
cl+ssl::libcrypto is also read at startup. If not properly closed in the
hooks, together with libssl, libcrypto will be loaded at startup and if
the first cl+ssl file alternative fails, the debugger is invoked.

* Fixes #1370
2022-06-23 13:28:35 +02:00
Christoph Berg
a94a0a3327 debian/tests/ssl: Force md5 auth if cl-postmodern is too old. 2021-12-22 18:08:21 +01:00
Christoph Berg
0925960989 pgloader 3.6.3 2021-12-22 17:27:14 +01:00
Christoph Berg
3b6fa226b8 Debian: Revert temporarily ignored file 2021-12-22 17:25:47 +01:00
Christoph Berg
4f1650f084 Debian: Remove obsolete lintian overrides 2021-12-22 17:24:50 +01:00
Christoph Berg
11dc31d05c docs/ref/pgsql-redshift.rst: Fix too short title underline 2021-12-22 17:07:31 +01:00
Christoph Berg
a8c50e37f8 Fix places2k.zip location
Close #375
2021-12-21 10:36:14 +01:00
ChristophKaser
40f6ba1ff4 Fixes typo in MS SQL Migration Options docs 2021-12-21 10:20:39 +01:00
Dmitry Shvetsov
2e728f5754 Fix typo in the log message 2021-12-21 10:10:38 +01:00
Christoph Berg
92dfb3f706 Debian: Remove cl-pgloader, deprecated upstream. 2021-12-21 10:10:23 +01:00
Phil Ingram
f49252d6b4 Add openssl-devel dependency to pgloader.spec 2021-12-09 16:56:09 +01:00
Scott Markwell
4bd4c0ef08 Spelling correction 2021-12-09 16:54:12 +01:00
marcel-tomes
a8512e60fa Fix typo 2021-12-09 16:53:25 +01:00