dim
|
277f4b313e
|
Document columns=* option and prepare 2.3.0~dev2 packages
|
2008-02-25 14:55:30 +00:00 |
|
dim
|
174ed31302
|
Adding support for columns=* configuration
|
2008-02-25 14:21:53 +00:00 |
|
dim
|
45176adec7
|
Don't wait for non started threads (PGLoader init could error out)
|
2008-02-25 14:11:33 +00:00 |
|
dim
|
579f25e067
|
Documentation of new parallel loading options
|
2008-02-16 19:53:43 +00:00 |
|
dim
|
f3f931c49e
|
Fixed init_time: set it in run(), no more in __init__()
|
2008-02-16 19:25:40 +00:00 |
|
dim
|
84738febfd
|
FIX round-robin reader case when not all configured threads are needed to load the file
|
2008-02-16 19:17:03 +00:00 |
|
dim
|
a27a801f62
|
Synchronize threads starts and ends with an Event
|
2008-02-15 21:14:45 +00:00 |
|
dim
|
45c670f576
|
FIX end-of-file boundary checking
|
2008-02-15 21:12:48 +00:00 |
|
dim
|
192da034c3
|
Handle more nicely connection errors - from python stacktrace to ERROR message
|
2008-02-15 09:53:06 +00:00 |
|
dim
|
ba366190cc
|
Adapt Makefile to build a RPM suitable archive file
|
2008-02-14 23:09:06 +00:00 |
|
dim
|
ca54951de7
|
Generalize unbuffered file reading to a file-like class and use it in csvreader and textreader. Almost ok now, or so it seems
|
2008-02-14 22:25:25 +00:00 |
|
dim
|
a905ac7521
|
FIX check_path calls, from user bug report
|
2008-02-14 20:15:30 +00:00 |
|
dim
|
610d3d6c2e
|
Split file reading works with text format (problem was file iterator buffering)
|
2008-02-14 17:17:55 +00:00 |
|
dim
|
a068a5ea6a
|
FIX just-introduced bug: no reader init meant self.db.copy_sep = None
|
2008-02-14 14:57:47 +00:00 |
|
dim
|
41f1a40e49
|
Factorize readers file opening code
|
2008-02-14 12:18:49 +00:00 |
|
dim
|
4bfaea7d83
|
FIX reader object init in the presence of templates
|
2008-02-14 12:08:29 +00:00 |
|
dim
|
4c45cc9d1c
|
DEBUG attempts of split_read_file(), renaming of internal methods, tests using text instead of csv
|
2008-02-13 17:12:30 +00:00 |
|
dim
|
f20ac7116e
|
Share Reject instance between every threads processing a given section, and protect the Reject.log() with a Lock
|
2008-02-13 11:30:18 +00:00 |
|
dim
|
e641b18fb3
|
Support for 'rrqueue_size' per-section configuration parameter, defaults to copy_every
|
2008-02-13 09:42:26 +00:00 |
|
dim
|
8200ceda36
|
Round Robin Reader seems ok now
|
2008-02-13 09:18:09 +00:00 |
|
dim
|
bac5d2b482
|
First implementation of Round Robin Reader threading method, Work In Progress --- does not work at all yet
|
2008-02-12 21:58:42 +00:00 |
|
dim
|
f60cf4c8c6
|
improve TODO asciidoc markup, print stats from section sub-threads
|
2008-02-12 17:44:29 +00:00 |
|
dim
|
6b40de9408
|
Add a TODO list, to avoid loosing track of ideas for next versions
|
2008-02-12 17:31:33 +00:00 |
|
dim
|
d02bf0a661
|
Update documentation to show how to have PostgreSQL generate columns list
|
2008-02-12 17:03:26 +00:00 |
|
dim
|
a2195ec2e7
|
Better handling of split_file_reading case, Still In Progress
|
2008-02-12 12:24:15 +00:00 |
|
dim
|
b534962192
|
Using semaphores to control how many max threads run at any given time
|
2008-02-12 11:27:18 +00:00 |
|
dim
|
fc8adf1831
|
First implementation of parallel loading, each thread loading a part of the input file (stat, seek, etc)
|
2008-02-11 17:38:52 +00:00 |
|
dim
|
165daa19fe
|
Fix -F which was broken from logging facility feature. Per user gripe (thanks)
|
2008-02-07 19:04:20 +00:00 |
|
dim
|
9e17976ef8
|
First attempt at a multi-threaded pgloader, seems to be ok though not configurable yet
|
2008-02-05 13:41:45 +00:00 |
|
dim
|
526836deca
|
database object is now initialized from PGLoader init
|
2008-02-05 11:45:30 +00:00 |
|
dim
|
60ffb4ba3f
|
pgloader no longer has to run VACUUM after having loaded all the tables
|
2008-02-05 11:20:07 +00:00 |
|
dim
|
f912b929cd
|
Document the new --disable-triggers option
|
2008-02-01 11:11:59 +00:00 |
|
dim
|
9bbb418397
|
Have options.py VERSION match debian package
|
2008-02-01 10:25:31 +00:00 |
|
dim
|
8605b14084
|
* pgloader -V now VACUUM each table separately, no more vacuumdb issued
* New option -D to DISABLE Triggers while loading (ENABLE them one done)
|
2008-02-01 10:24:39 +00:00 |
|
dim
|
3cf6722636
|
HISTORY review, per hints from Christopher Kings-Lynne
|
2007-12-20 08:50:10 +00:00 |
|
dim
|
70b3def565
|
New logging mecanism init fix, when nothing is configured
|
2007-12-10 10:35:59 +00:00 |
|
dim
|
50f0ab5d4d
|
debian packaging: fixes for lintian warnings
|
2007-12-09 21:17:44 +00:00 |
|
dim
|
851eeaaac3
|
make site target for uploading html documentation
|
2007-12-08 20:19:32 +00:00 |
|
dim
|
b367b562f1
|
pgloader 2.2.5 hits cvs
|
2007-12-07 22:25:28 +00:00 |
|
dim
|
a530dedd66
|
* Rework DatabaseError and consider dichotomy in this case too.
* New options lc_messages and log_file
|
2007-12-07 21:13:35 +00:00 |
|
dim
|
aed566bb0d
|
Do not use no more DEBUG, VERBOSE and QUIET globals
|
2007-12-07 18:28:19 +00:00 |
|
dim
|
efecde9f5b
|
new logging options documentation
|
2007-12-07 14:37:28 +00:00 |
|
dim
|
f0d6a8a37e
|
Systematic usage of new logger module
|
2007-12-07 14:24:29 +00:00 |
|
dim
|
5da357c262
|
Beginning of real logging implementation for pgloader messages
|
2007-12-04 23:08:30 +00:00 |
|
dim
|
20d579cca6
|
More aggressive cleaning for preparing the orig tarball for debian
packaging.
|
2007-12-03 10:10:00 +00:00 |
|
dim
|
0afb47a00c
|
debian/control now supports a Homepage field
|
2007-12-03 09:28:27 +00:00 |
|
dim
|
2f783639ef
|
debian packaging review, second pass
|
2007-12-03 09:13:30 +00:00 |
|
dim
|
28f7364161
|
debian packaging review by Julien Danjou
|
2007-12-02 17:37:58 +00:00 |
|
dim
|
1116b2ceac
|
FIX debian packaging wrt pysupport proper usage.
pgloader modules now are installed into /usr/share/python-support/pgloader
|
2007-12-01 10:15:29 +00:00 |
|
dim
|
88887cf2f1
|
debian packaging, Closes #453434 (ITP)
|
2007-11-29 21:38:13 +00:00 |
|