26 Commits

Author	SHA1	Message	Date
Dimitri Fontaine	b072298937	It's unfortunately not possible to SET gucs once already in COPY "mode".	2013-09-19 23:32:53 +02:00
Dimitri Fontaine	b9d0edb0ee	Fix pgloader.pgsql:get-connection-spec for port handling.	2013-09-18 17:40:43 +02:00
Dimitri Fontaine	e78106c60b	Implement GUCs handling.	2013-08-08 17:10:33 +02:00
Dimitri Fontaine	5ed766c570	Fully integrate data transformation rules.	2013-08-07 18:42:48 +02:00
Dimitri Fontaine	995ef02a42	Use LISTEN/NOTIFY to avoid counting sequences twice.	2013-03-18 18:33:02 +01:00
Dimitri Fontaine	13fcf9f096	Clean-up connection parameters and their default values.	2013-03-16 23:21:32 +01:00
Dimitri Fontaine	5674191534	Switch to the new lparalel.queue:make-queue API.	2013-03-16 23:20:23 +01:00
Dimitri Fontaine	72c783f02f	Add some preliminary logging capacity	2013-03-16 16:47:10 +01:00
Dimitri Fontaine	d2b040f197	Tweak the special declarations to enhance readability.	2013-03-10 23:03:21 +01:00
Dimitri Fontaine	28164457c0	Simplify the code by using the dynamic variables properties.	2013-03-10 22:35:52 +01:00
Dimitri Fontaine	debe605427	Implement timing reporting in pgloader.pgsql:copy-from-file	2013-03-09 14:42:35 +01:00
Dimitri Fontaine	713594b5fc	Fix batch splitting and retrying.	2013-03-09 14:34:17 +01:00
Dimitri Fontaine	f4ac2b67db	Implement resetting all sequences at the end of the streaming.	2013-02-26 17:06:26 +01:00
Dimitri Fontaine	b6f9b249ba	Implement MySQL Schema Support (create table)	2013-02-21 22:41:54 +01:00
Dimitri Fontaine	2cbf43a271	Implement guessing CSV parameters.	2013-02-12 23:57:04 +01:00
Dimitri Fontaine	4bdfc4097f	Implement some CSV parse error handling.	2013-02-11 22:10:50 +01:00
Dimitri Fontaine	9524007e8a	Fix the importing from a PostgreSQL COPY TEXT file.	2013-02-11 13:40:07 +01:00
Dimitri Fontaine	4353d168fe	Refactor the copy-from-queue and its error management.	2013-02-10 22:33:32 +01:00
Dimitri Fontaine	2c80996d85	Cleanup internal API and stats reporting.	2013-02-08 22:10:37 +01:00
Dimitri Fontaine	a9d6b7c2c7	Assorted changes (defaults, log file management).	2013-02-08 12:35:54 +01:00
Dimitri Fontaine	d795ac02c2	Send errors into separate files (logs, data), fix system loading and parameters.	2013-02-07 22:58:46 +01:00
Dimitri Fontaine	f6bdf64c7c	Cleanup the package definitions and inter-dependancy, and implement a proper data structure for sharing stats about what's happening.	2013-02-07 21:55:10 +01:00
Dimitri Fontaine	08f7791f66	Arrange to report errors per table in the reports.	2013-02-07 18:15:01 +01:00
Dimitri Fontaine	68a49835de	fix an off-by-one error and condition reporting.	2013-02-07 17:21:42 +01:00
Dimitri Fontaine	edb12ce3f8	Implement basic error management of data so that COPY still imports the good rows.	2013-02-07 15:26:29 +01:00
Dimitri Fontaine	623e2d4ff7	Massive Refactoring, towards pgloader.	2013-02-07 00:04:12 +01:00