104 Commits

Author SHA1 Message Date
dim
23b19d381e debian packaging bug#485067: Missing Build-Depends 2008-06-09 13:25:34 +00:00
dim
85caa89c03 Consider XML support as a TODO item 2008-06-09 13:21:23 +00:00
dim
b1664ae94c debian package related corrections 2008-06-03 12:58:14 +00:00
dim
ee513ed07a 2.3.1 release 2008-06-03 12:18:17 +00:00
dim
5b8f3b1e2f Document host setting for Unix Domain Socket connection support 2008-05-29 09:23:27 +00:00
dim
5a63f4f609 Protect the database connection establishing into the parralel sections semaphore, allow field_sep to be configured to \t, and some fixes 2008-05-29 09:16:13 +00:00
dim
d068b05ae2 Build tablename and COPY column list only at COPY time, not for each line 2008-05-28 10:07:45 +00:00
dim
b7c7e6a7c1 Support for fixed format datafile 2008-05-21 10:33:06 +00:00
dim
2d503ad0fa Close database connection on PGLoader object destruction, and on terminate() too 2008-05-21 07:44:30 +00:00
dim
32874eaede Typos (proof-read by Simon Riggs, I configured english flyspell to try and spot them all) 2008-03-10 20:18:18 +00:00
dim
0d53197dc8 Avoid including CVSROOT into releases 2008-03-10 15:29:45 +00:00
dim
18a7a48581 update published TODO before release 2008-03-10 15:11:17 +00:00
dim
010629143c update options.py to VERSION 2.3.0 2008-03-10 14:51:12 +00:00
dim
f13dd16dba fix the bugfix for cases when field_count is not used (None) 2008-03-10 14:44:02 +00:00
dim
1843c84636 FIX the cluttered example (see BUGS.txt), prepare 2.3.0 packaging 2008-03-10 14:39:38 +00:00
dim
620362bace cvsignore setting showed forgotten file to add 2008-03-10 13:33:20 +00:00
dim
62f9d5a50b FIX: PSYCOPG_VERSION defaults to None... 2008-02-27 12:56:18 +00:00
dim
e15ac609a8 Allow user to force psycopg version to use, as psycopg2 is not always the best choice 2008-02-27 12:30:13 +00:00
dim
b47a56bba1 FIX Makefile to ignore some parallel files 2008-02-25 17:26:09 +00:00
dim
a018ddac95 TODO update with status, preparing a debian experimental release 2008-02-25 16:27:07 +00:00
dim
ca2ba09c6a Fix Makefile archive building 2008-02-25 15:47:18 +00:00
dim
6c86d20c4c Let's try to keep a record of BUGS 2008-02-25 14:56:10 +00:00
dim
277f4b313e Document columns=* option and prepare 2.3.0~dev2 packages 2008-02-25 14:55:30 +00:00
dim
174ed31302 Adding support for columns=* configuration 2008-02-25 14:21:53 +00:00
dim
45176adec7 Don't wait for non started threads (PGLoader init could error out) 2008-02-25 14:11:33 +00:00
dim
579f25e067 Documentation of new parallel loading options 2008-02-16 19:53:43 +00:00
dim
f3f931c49e Fixed init_time: set it in run(), no more in __init__() 2008-02-16 19:25:40 +00:00
dim
84738febfd FIX round-robin reader case when not all configured threads are needed to load the file 2008-02-16 19:17:03 +00:00
dim
a27a801f62 Synchronize threads starts and ends with an Event 2008-02-15 21:14:45 +00:00
dim
45c670f576 FIX end-of-file boundary checking 2008-02-15 21:12:48 +00:00
dim
192da034c3 Handle more nicely connection errors - from python stacktrace to ERROR message 2008-02-15 09:53:06 +00:00
dim
ba366190cc Adapt Makefile to build a RPM suitable archive file 2008-02-14 23:09:06 +00:00
dim
ca54951de7 Generalize unbuffered file reading to a file-like class and use it in csvreader and textreader. Almost ok now, or so it seems 2008-02-14 22:25:25 +00:00
dim
a905ac7521 FIX check_path calls, from user bug report 2008-02-14 20:15:30 +00:00
dim
610d3d6c2e Split file reading works with text format (problem was file iterator buffering) 2008-02-14 17:17:55 +00:00
dim
a068a5ea6a FIX just-introduced bug: no reader init meant self.db.copy_sep = None 2008-02-14 14:57:47 +00:00
dim
41f1a40e49 Factorize readers file opening code 2008-02-14 12:18:49 +00:00
dim
4bfaea7d83 FIX reader object init in the presence of templates 2008-02-14 12:08:29 +00:00
dim
4c45cc9d1c DEBUG attempts of split_read_file(), renaming of internal methods, tests using text instead of csv 2008-02-13 17:12:30 +00:00
dim
f20ac7116e Share Reject instance between every threads processing a given section, and protect the Reject.log() with a Lock 2008-02-13 11:30:18 +00:00
dim
e641b18fb3 Support for 'rrqueue_size' per-section configuration parameter, defaults to copy_every 2008-02-13 09:42:26 +00:00
dim
8200ceda36 Round Robin Reader seems ok now 2008-02-13 09:18:09 +00:00
dim
bac5d2b482 First implementation of Round Robin Reader threading method, Work In Progress --- does not work at all yet 2008-02-12 21:58:42 +00:00
dim
f60cf4c8c6 improve TODO asciidoc markup, print stats from section sub-threads 2008-02-12 17:44:29 +00:00
dim
6b40de9408 Add a TODO list, to avoid loosing track of ideas for next versions 2008-02-12 17:31:33 +00:00
dim
d02bf0a661 Update documentation to show how to have PostgreSQL generate columns list 2008-02-12 17:03:26 +00:00
dim
a2195ec2e7 Better handling of split_file_reading case, Still In Progress 2008-02-12 12:24:15 +00:00
dim
b534962192 Using semaphores to control how many max threads run at any given time 2008-02-12 11:27:18 +00:00
dim
fc8adf1831 First implementation of parallel loading, each thread loading a part of the input file (stat, seek, etc) 2008-02-11 17:38:52 +00:00
dim
165daa19fe Fix -F which was broken from logging facility feature. Per user gripe (thanks) 2008-02-07 19:04:20 +00:00