mirrors/pgloader
1
0
Fork 0
mirror of https://github.com/dimitri/pgloader.git synced 2025-08-10 08:17:00 +02:00
Code Issues Projects Releases Wiki Activity
1e436555a8
pgloader/test
History
Dimitri Fontaine 0549e74f6d Implement multiple reader per table for MySQL. 
Experiment with the idea of splitting the read work in several concurrent
threads, where each reader is reading portions of the target table, using a
WHERE id <= x and id > y clause in its SELECT query.

For this to kick-in a number of conditions needs to be met, as described in
the documentation. The main interest might not be faster queries to overall
fetch the same data set, but better concurrency with as many readers as
writters and each couple its own dedicated queue.
2017-06-28 16:23:18 +02:00
..
data Implement support for PostgreSQL COPY format, fix #145. 2015-01-02 18:49:17 +01:00
parse Allow package prefix in CAST ... USING clause. 2016-02-04 16:09:22 +01:00
regress Review transaction and error handling in COPY. 2016-02-21 15:56:06 +01:00
sqlite Refactor error handling in complete-pgsql-database. 2017-06-08 12:09:11 +02:00
allcols.load Improve database connection parsing to use sensible defaults. 2013-10-19 22:39:09 +02:00
archive.load Review the stats and reporting code organisation. 2015-10-05 01:46:29 +02:00
bossa-all.load Improve tests and add test cases. 2013-11-26 16:48:45 +01:00
bossa.load Update an old archive test case. 2016-08-28 20:29:30 +02:00
bossa.sql Improve tests and add test cases. 2013-11-26 16:48:45 +01:00
census-places.load Fix census-places URL location of the source file. 2015-04-17 21:58:19 +02:00
copy-hex.load Implement more COPY options, fix #218. 2015-04-30 14:30:16 +02:00
copy.load Fix index creation reporting, see #251. 2015-07-18 23:06:15 +02:00
csv-before-after.load Fix quoting of TRUNCATE command, fix #84. 2014-06-20 13:10:39 +02:00
csv-districts-stdin.load Fix loading data from stdin: fix #53. 2014-04-27 23:38:02 +02:00
csv-districts.load Implement the option to disable triggers when loading data. 2015-02-19 15:05:10 +01:00
csv-error.load Fix issue #49 where data could be considered as a format string. 2014-04-23 17:03:35 +02:00
csv-escape-mode.load Add test coverage for #80. 2015-06-25 14:16:12 +02:00
csv-filename-pattern.load Fix corner case in creating indexes again. 2016-11-20 17:17:15 +01:00
csv-header.load Fix more table name quoting, fix #163 again. 2015-12-08 11:52:43 +01:00
csv-hstore.load Don't double-quote identifiers in catalog queries. 2017-01-10 21:12:34 +01:00
csv-json.load Allow for more options in the CSV escape character, fix #38. 2015-05-22 12:31:06 +02:00
csv-keep-extra-blanks.load Switch to the newer cl-csv API. 2014-01-11 18:28:24 +01:00
csv-missing-col.load Review transaction and error handling in COPY. 2016-02-21 15:56:06 +01:00
csv-newline.load Implement new CSV option "lines terminated by", fixes #23. 2014-02-04 20:58:46 +01:00
csv-non-printable.load Allow any character in a quoted CSV field name. 2016-08-07 20:35:37 +02:00
csv-nulls.load Square brackets around source field options are now mandatory. 2014-10-02 01:17:24 +02:00
csv-parse-date.load Fix double transformation call in CSV projections. 2017-03-04 15:55:08 +01:00
csv-temp.load Improve user code parsing, fix #297. 2015-09-21 13:23:21 +02:00
csv-trim-extra-blanks.load Switch to the newer cl-csv API. 2014-01-11 18:28:24 +01:00
csv.load Handle camelCase column names for CSV, fix #79 again. 2014-06-16 17:33:14 +02:00
dbf-zip.load Improve database connection parsing to use sensible defaults. 2013-10-19 22:39:09 +02:00
dbf.load Fix schema qualified table names usage (more). 2015-09-04 01:06:15 +02:00
errors.load Travis: adapt to PostgreSQL 9.1, again. 2015-11-23 22:09:08 +01:00
fields-with-periods.load Accept periods in CSV field names 2015-05-15 07:22:07 -07:00
fixed.load Implement drop indexes option for copy and fixed. 2015-07-16 21:39:06 +02:00
geolite.sql Implement BEFORE/AFTER LOAD EXECUTE 'filename'. 2014-05-04 23:04:45 +02:00
ixf.load Provide "on error stop" as a WITH option. 2017-06-01 16:43:09 +02:00
Makefile Travis: let's actually use the new EXTRA_OPTS. 2017-06-14 21:32:41 +02:00
nofile.load Improve tests and add test cases. 2013-11-26 16:48:45 +01:00
overflow.load Add automated regression tests. 2014-06-03 12:19:23 +02:00
partial.load Another attempt at fixing #323. 2016-01-17 01:54:36 +01:00
README.md Port tests from pgloader 2.x, implement trailing-sep. 2013-10-13 22:10:07 +02:00
reformat.load Improve database connection parsing to use sensible defaults. 2013-10-19 22:39:09 +02:00
sakila-data.load Allow ALTER SCHEMA command for MySQL. 2016-12-18 19:31:21 +01:00
sakila.load Implement multiple reader per table for MySQL. 2017-06-28 16:23:18 +02:00
serial.load Improve database connection parsing to use sensible defaults. 2013-10-19 22:39:09 +02:00
simple.load Improve database connection parsing to use sensible defaults. 2013-10-19 22:39:09 +02:00
sqlite-base64.load Review SQLite blob types in light of "manifest typing", fix #60. 2014-05-16 23:13:57 +02:00
sqlite-chinook.load Provide "on error stop" as a WITH option. 2017-06-01 16:43:09 +02:00
sqlite-testpk.load Refactor error handling in complete-pgsql-database. 2017-06-08 12:09:11 +02:00
sqlite.load Fix "drop default" casting rule. 2017-06-08 21:39:06 +02:00
udc.load Improve parsing of list separating commas wrt to whitespacing. 2013-11-23 21:49:08 +01:00
xzero.load Square brackets around source field options are now mandatory. 2014-10-02 01:17:24 +02:00

README.md

pgloader tests

In the parser directory are tests for the parser only, in the current directory are tests that can be run to import data.