98 Commits

Author SHA1 Message Date
Christoph Berg
af8c3c1472 pgloader 3.6.10 2023-11-02 16:49:50 +00:00
Christoph Berg
3e06d1b9e1 New version 3.6.9 2022-10-24 13:12:05 +02:00
Christoph Berg
759777ae08 New upstream version. 2022-09-26 14:25:44 +02:00
Christoph Berg
755b55d2b3 New upstream version 2022-08-13 10:35:39 +02:00
Christoph Berg
b24eba972d Set SBCL dynamic space size to 16 GB on 64 bit architectures. 2022-08-12 22:57:51 +02:00
Christoph Berg
2c52da12cb Sync version numbers 2022-06-27 11:03:22 +02:00
Christoph Berg
10ee9d931a Remove regression output on clean 2022-06-26 23:32:55 +02:00
Christoph Berg
12d4885f3d Remove bundle files on clean 2022-06-24 16:22:00 +02:00
Christoph Berg
a56f5a4b25 Build bundle file
Close #1347
2022-06-24 16:17:29 +02:00
Christoph Berg
3f1ca18229 New upstream version 3.6.4 2022-06-24 14:39:50 +02:00
Christoph Berg
b54ed07175 Ignore some Debian build artifacts 2022-06-23 16:08:36 +02:00
Christoph Berg
0925960989 pgloader 3.6.3 2021-12-22 17:27:14 +01:00
Michał "phoe" Herda
e235c6049d
Update Quicklisp dist to 2020-02-18 (#1106)
#1092 requires us to switch to a new Quicklisp distribution in order to bump CFFI to version 0.21.0. This commit switches to the newest available QL dist (2020-02-18) to achieve this.
2020-03-22 16:59:19 +01:00
Michał "phoe" Herda
94d0612c12
Do not reload pgloader in Makefile (#1091) 2020-03-21 12:36:31 +01:00
Dimitri Fontaine
954eca02d0 Optimize Travis-CI workload.
Before this patch Travis would build the pgloader image twice, one when
doing the `make clones save` command and another time when doing the main
command `make check`, that depends on Make targets that `make save` does not
build, such as buildapp.

Also, fix `make check-saved` to stop requiring that we save pgloader again.

Finally, use uiop:featurep to clean-up the code in the src/save.lisp file.
2019-05-09 10:52:09 +02:00
Dimitri Fontaine
eafaf80b3c Back to non-release development.
Master's branch is now preparing for 3.6.2.
2019-01-21 17:51:44 +01:00
Dimitri Fontaine
25c937879a Fix building for 3.6.1.
The pgloader-image feature must be added in the lisp image before
reading/compiling the pgloader sources for it to be useful.
2019-01-21 15:02:39 +01:00
Dimitri Fontaine
1306b4c953 Desultory improvements.
Killing tasks in the error handling must be done carefully, and given this
testing session it seems better to refrain from doing it when erroring out
at COPY init time (missing column is an example of that). The approach
around that is still very much ad-hoc rather than systematic.

In passing improve the `make save` option to producing a binary image: have
the make recipe respect the CL variable. The command line options
differences were already accounted for.
2019-01-09 18:57:33 +01:00
Dimitri Fontaine
9ce4088b48 Improvements to the make save facility. 2019-01-07 20:44:16 +01:00
Dimitri Fontaine
6e325f67e0 Implement the save.lisp idea for the bundle.
This should make it easier to build pgloader with CCL rather than SBCL, all
from the bundle distribution, and also easier to support windows.

In passing, add a new file in the bundle distribution: version.sexp should
contain a CL string containing the pgloader version string.
2018-11-21 21:44:56 +01:00
Dimitri Fontaine
1c18b41cd7 Implement a new way of building pgloader: make save.
This time we directly call into the save-lisp-and-die feature of the
implementation. As pgloader only supports SBCL and CCL at the time being,
doing things without an abstraction layer is easy enough.

This needs more testing and a special version for the bundle case too. One
step at a time, etc.
2018-11-20 22:59:43 +01:00
Dimitri Fontaine
63af7e7373 Release 3.5.2.
This release fixes debian packaging, includes support for Redhift as a
target, and also fixes some bugs.
2018-07-03 16:58:55 +02:00
Christoph Berg
cb528c2e19 All included test data has been verified as free, stop building a +dfsg tarball. 2018-07-03 16:37:43 +02:00
Christoph Berg
f19e301c81 debian: Build sphinx docs
While we are at it, remove built docs on clean
2018-06-25 15:02:32 +02:00
Dimitri Fontaine
1f354131d0 Release pgloader 3.5.1.
Lots of bug fixes did happen, time to release.
2018-05-17 10:41:40 +02:00
Dimitri Fontaine
f30f596eca Review bundle and regression test facilities.
Some path computation didn't work when trying to regression test the
produced bundle.

Also, the bundle building steps would use the pgloader system definition and
dependencies from what's currently available in Quicklisp rather than from
the local pgloader.asd being built.
2018-05-17 10:39:32 +02:00
Christoph Berg
8e3ebd5f1e Remove obsolete "make docs" target
pgloader.1.md doesn't exist anymore
2018-02-13 21:02:59 +01:00
Dimitri Fontaine
52720a5e6f Prefer QL overrides to ASDF setup.
The ql:*local-project-directories* is a much better facility for us to load
pgloader from the local PWD rather than from the QL distribution. It looks
like the previous method worked by accident, for once, and also downloaded
pgloader from QL, unnecessarily (we have the sources locally).
2017-10-03 13:47:48 +02:00
Dimitri Fontaine
38a6b4968d Improve bundle building.
Now when building a bundle file for source distribution of pgloader, always
test it by building a binary image from the bundle tarball in a test
directory. Also make it easy to target "latest" Quicklisp distribution with
the following spelling:

    make BUNDLEDIST=latest bundle
2017-08-01 19:20:15 +02:00
Dimitri Fontaine
72431d4708 Improve the Quicklist dist support for bundles.
When distributing a pgloader bundle we're using the ql-dist facility. In
recent commit we hand-picked the last known working distribution of
quicklisp for pgloader. Make it easy to target "latest" known distribution
or hard-code one from the Makefile or the bundle/ql.lisp file.
2017-08-01 18:48:20 +02:00
Dimitri Fontaine
64959595fc Back to development release in the master's branch. 2017-07-06 16:55:56 +02:00
Dimitri Fontaine
d71da6ba66 Release pgloader 3.4.1 2017-07-06 16:53:29 +02:00
Dimitri Fontaine
c02defa5f0 Travis: explicitely pass down the CL variable.
It seems that the test/Makefile didn't get the memo.
2017-06-14 21:25:18 +02:00
Dimitri Fontaine
1469789ede Try to get more information from CCL in testing.
The “magic” options --batch and --heap-reserve will be processed by CCL
itself before pgloader gets to see them, so try that in the testing
environment.
2017-06-14 21:12:54 +02:00
Dimitri Fontaine
2c644d55f2 Add --batch to CCL run options.
This option provides lots of information when it crashes, and should help us
with understanding Travis and DockerHub errors with CCL.
2017-06-14 11:49:22 +02:00
Dimitri Fontaine
effa916b31 Improve parallelism setup documentation.
The code comment displayed in the release notes for 3.3.1 is reported to
be better at explaining the concurrency control than what we had in the
main documentation, so add it there.

Fix #496.
2017-01-03 23:13:01 +01:00
Dimitri Fontaine
ac202dc70e Prepare release 3.3.2. 2016-12-03 17:38:52 +01:00
Dimitri Fontaine
cb30891fbb Release pgloader v3.3.1. 2016-08-28 20:31:31 +02:00
Dimitri Fontaine
ffef9bc28e Improve pgloader bundle distribution.
Include the local git clones in the bundle so that git is not needed at
build time for consumers of the bundle. Fixes #428.
2016-08-07 21:30:48 +02:00
alex
09c178c33b makefile: perform shallow clones when cloning deps (#405) 2016-05-16 20:17:47 +02:00
P.Y. Laligand
8523410555 Removed reference to defunct build target. 2016-03-26 12:19:54 -07:00
Dimitri Fontaine
7b33b9c853 Switch back again to the main esrap code.
The WIP branch about better error messages made its way through the main
code, so switch back to the mainline as available directly in Quicklisp.

See https://github.com/nikodemus/esrap/issues/26.
2016-03-26 18:36:04 +01:00
Dimitri Fontaine
e7771ff3d8 Remove platform specific tar options. 2016-02-02 15:28:00 +01:00
Dimitri Fontaine
029ea0027a Upgrade version string.
We just tagged the repository as version 3.3.0.50 to be able to release
an experimental pgloader bundle, and we did tag the repository. The
first commit after that should then change the version string.
2016-01-31 21:49:43 +01:00
Dimitri Fontaine
1280ae0b8c Add a bundle distribution.
Using Quicklisp bundle facility it is possible to prepare a
self-contained archive of all the code needed to build pgloader.

Doing that should allow users to easily build pgloader when they are
being a restrictive proxy, and packagers to work from a source tarball
that has a very limited build dependencies.
2016-01-31 21:47:14 +01:00
Richard Michael
6dcdf4711b Easier install by detecting SBCL core-compression.
Various Linux distributions provide SBCL without core-compression
enabled. On the other hand, Mac OSX (at least via `homebrew`) SBCL with
core-compression enabled.  To make installation easier, teach the make
process to detect core-compression, and use it if possible.
2016-01-09 22:17:02 -05:00
Dimitri Fontaine
d1a2e3f46b Improve the Dockerfile and the versioning.
When building from sources within the git environement, the version
number is ok, but it was wrong when building in the docker image. Fix
the version number to 3.3.0.50 to show that we're talking about a
development snapshot that is leading to version 3.3.1.

Yeah, 4 parts version numbers. That happens, apparently.
2016-01-07 10:21:52 +01:00
Nikhil Benesch
fe35487048 Match pgloader-standalone target to pgloader target 2015-03-23 17:03:34 -04:00
Dimitri Fontaine
55584406fa Add encoding support for db3 sources, fix #176.
It appears that db3 files are not limited to the ASCII character
encoding that they were designed with, so let's clue pgloader about
that.

This commit build
770cbe3526
and the pgloader Makefile has been updated to momentarily fetch cl-db3
from github rather than Quicklisp so that it's possible to enjoy the new
feature immediately.
2015-02-18 22:40:03 +01:00
Dimitri Fontaine
28f6a87165 Interim release and forward porting from rel_3_2_stable.
Given the slashdot effect and some bad luck, the binary artefacts of the
3.2.0 release are not currently available, and anyway contain known bugs
that have been fixed meanwhile thanks to early adopters who did open
issues on github.

So we hastily publish the current master's branch version as a github
release with binary files.
2015-01-22 02:25:14 +01:00