Commit Graph

132 Commits

Author SHA1 Message Date
Davlet Panech
a206b18f8b better import placement 2010-09-27 11:32:12 -04:00
Davlet Panech
d07bddc153 Disable KeyboardInterrupt, just exit on SIGINT.
The KeyboardInterrupt exception doesn't get raised if the script
is stuck in a blocking call, i.e., inside the check_event function.
So pressing CTRL+C has no effect.

This patch disables the exception, reverting to the OS' default
behaviour for the SIGINT signal (i.e., terminate the program).
2010-09-20 17:44:07 -04:00
Dimitri Fontaine
b323952e63 Fix work in progress line encoding in reader.py to not touch read data if self.encoding is None 2010-08-25 18:00:54 +02:00
Dimitri Fontaine
d9c923590e Fix reader.py logging when using -C 2010-08-25 18:00:21 +02:00
Dimitri Fontaine
4e5fec95e3 Fix connection management bug when columns = *.
Instead of opening a connection per section and leaving it open until the
end for the run, open a connection just for getting this section columns
then close it. Per gripes from a user dealing with 90000 sections.
2010-04-29 17:14:44 +02:00
Dimitri Fontaine
a062db184d Avoid calling self.fd.tell() when we're reading from stdin.
That means the options --load-from-stdin and --boundaries are not compatible.
2010-04-29 13:20:44 +02:00
Dimitri Fontaine
f154d9bf83 Implement --boundaries to load a part of a file only (given in bytes). 2010-04-15 16:59:06 +02:00
Dimitri Fontaine
1738aaa6aa Add forgotten exemple, fixed input cols. 2010-04-15 16:55:37 +02:00
Dimitri Fontaine
cbd167c0e8 Implement --load-from-stdin 2010-04-15 16:55:10 +02:00
Dimitri Fontaine
38c8a079f2 Bugfix: MAX_PARALLEL_SECTIONS should not be None, even if not given on command line. 2010-04-07 14:11:10 +02:00
Dimitri Fontaine
efa4b6b103 Package version 2.3.3~dev1 for some testing. Won't get released yet. 2010-04-06 16:45:46 +02:00
Dimitri Fontaine
1b6c0f4735 Implement support for the CVS field_size_limit, new in python 2.5. 2010-04-06 16:35:39 +02:00
Dimitri Fontaine
411a9a53d7 Add support for PG options as arguments and in the config file, with assorted fixes 2010-04-05 21:17:22 +02:00
Dimitri Fontaine
d63b21c3f9 Update the debian changelog for 2.3.3 2010-04-05 01:07:40 +02:00
Dimitri Fontaine
201209259a Implement --reject-log and --reject-data options. 2010-04-05 01:02:30 +02:00
Dimitri Fontaine
ac0a16f9b2 Add support for --max-parallel-sections and --section-threads from command line. 2010-04-05 00:32:46 +02:00
Dimitri Fontaine
b7b0bbc62d Support for processing a filename rather than a section, and add --field-separator 2010-04-04 20:42:40 +02:00
Dimitri Fontaine
99df251963 Adding missed file, parallel data exemple 2010-04-04 19:32:48 +02:00
dim
8af4355994 release 2.3.2 2009-06-29 10:30:46 +00:00
dim
43c95d67c2 python-support is needed for pgloader to run, not only to build 2009-04-28 13:56:37 +00:00
dim
090de905b2 Implement skip_head_lines in configuration file, some more bugfixes 2009-03-10 17:56:16 +00:00
dim
848595f49b Some more python2.3 support changes 2008-09-18 12:58:12 +00:00
dim
2bacf1a854 FIX RRR bug wrt offsets, allow python 2.3 to run pgloader when it does not need collections.deque (no Round Robin Reader), and prepare packaging for 2.3.2 2008-09-17 16:55:30 +00:00
dim
ea03303e27 Use psycopg cursor.copy_expert() when avaiable (> 2.0.6), which should fix problems tied to too small copy buffer, per Marko's comment on Skytools project 2008-09-05 12:52:18 +00:00
dim
5f335eda28 FIX fixed reader: it now know about -C 2008-09-05 12:50:43 +00:00
dim
094313d7ff Preliminary support for real line numbers usage in logs, ok for simple cases --- no split_file_reading, multi-line input broken 2008-08-07 22:49:22 +00:00
dim
0e42971ea0 some more facilities in the TODO list 2008-07-27 18:00:43 +00:00
dim
e9fdd8e0b7 FIXES: add -F and -C supports to CSV format, cvs doublequotes defaults to True, per Andrew Dunstan gripes 2008-07-24 16:22:52 +00:00
dim
23b19d381e debian packaging bug#485067: Missing Build-Depends 2008-06-09 13:25:34 +00:00
dim
85caa89c03 Consider XML support as a TODO item 2008-06-09 13:21:23 +00:00
dim
b1664ae94c debian package related corrections 2008-06-03 12:58:14 +00:00
dim
ee513ed07a 2.3.1 release 2008-06-03 12:18:17 +00:00
dim
5b8f3b1e2f Document host setting for Unix Domain Socket connection support 2008-05-29 09:23:27 +00:00
dim
5a63f4f609 Protect the database connection establishing into the parralel sections semaphore, allow field_sep to be configured to \t, and some fixes 2008-05-29 09:16:13 +00:00
dim
d068b05ae2 Build tablename and COPY column list only at COPY time, not for each line 2008-05-28 10:07:45 +00:00
dim
b7c7e6a7c1 Support for fixed format datafile 2008-05-21 10:33:06 +00:00
dim
2d503ad0fa Close database connection on PGLoader object destruction, and on terminate() too 2008-05-21 07:44:30 +00:00
dim
32874eaede Typos (proof-read by Simon Riggs, I configured english flyspell to try and spot them all) 2008-03-10 20:18:18 +00:00
dim
0d53197dc8 Avoid including CVSROOT into releases 2008-03-10 15:29:45 +00:00
dim
18a7a48581 update published TODO before release 2008-03-10 15:11:17 +00:00
dim
010629143c update options.py to VERSION 2.3.0 2008-03-10 14:51:12 +00:00
dim
f13dd16dba fix the bugfix for cases when field_count is not used (None) 2008-03-10 14:44:02 +00:00
dim
1843c84636 FIX the cluttered example (see BUGS.txt), prepare 2.3.0 packaging 2008-03-10 14:39:38 +00:00
dim
620362bace cvsignore setting showed forgotten file to add 2008-03-10 13:33:20 +00:00
dim
62f9d5a50b FIX: PSYCOPG_VERSION defaults to None... 2008-02-27 12:56:18 +00:00
dim
e15ac609a8 Allow user to force psycopg version to use, as psycopg2 is not always the best choice 2008-02-27 12:30:13 +00:00
dim
b47a56bba1 FIX Makefile to ignore some parallel files 2008-02-25 17:26:09 +00:00
dim
a018ddac95 TODO update with status, preparing a debian experimental release 2008-02-25 16:27:07 +00:00
dim
ca2ba09c6a Fix Makefile archive building 2008-02-25 15:47:18 +00:00
dim
6c86d20c4c Let's try to keep a record of BUGS 2008-02-25 14:56:10 +00:00