Davlet Panech
a206b18f8b
better import placement
2010-09-27 11:32:12 -04:00
Davlet Panech
d07bddc153
Disable KeyboardInterrupt, just exit on SIGINT.
...
The KeyboardInterrupt exception doesn't get raised if the script
is stuck in a blocking call, i.e., inside the check_event function.
So pressing CTRL+C has no effect.
This patch disables the exception, reverting to the OS' default
behaviour for the SIGINT signal (i.e., terminate the program).
2010-09-20 17:44:07 -04:00
Dimitri Fontaine
b323952e63
Fix work in progress line encoding in reader.py to not touch read data if self.encoding is None
2010-08-25 18:00:54 +02:00
Dimitri Fontaine
d9c923590e
Fix reader.py logging when using -C
2010-08-25 18:00:21 +02:00
Dimitri Fontaine
4e5fec95e3
Fix connection management bug when columns = *.
...
Instead of opening a connection per section and leaving it open until the
end for the run, open a connection just for getting this section columns
then close it. Per gripes from a user dealing with 90000 sections.
2010-04-29 17:14:44 +02:00
Dimitri Fontaine
a062db184d
Avoid calling self.fd.tell() when we're reading from stdin.
...
That means the options --load-from-stdin and --boundaries are not compatible.
2010-04-29 13:20:44 +02:00
Dimitri Fontaine
f154d9bf83
Implement --boundaries to load a part of a file only (given in bytes).
2010-04-15 16:59:06 +02:00
Dimitri Fontaine
1738aaa6aa
Add forgotten exemple, fixed input cols.
2010-04-15 16:55:37 +02:00
Dimitri Fontaine
cbd167c0e8
Implement --load-from-stdin
2010-04-15 16:55:10 +02:00
Dimitri Fontaine
38c8a079f2
Bugfix: MAX_PARALLEL_SECTIONS should not be None, even if not given on command line.
2010-04-07 14:11:10 +02:00
Dimitri Fontaine
efa4b6b103
Package version 2.3.3~dev1 for some testing. Won't get released yet.
2010-04-06 16:45:46 +02:00
Dimitri Fontaine
1b6c0f4735
Implement support for the CVS field_size_limit, new in python 2.5.
2010-04-06 16:35:39 +02:00
Dimitri Fontaine
411a9a53d7
Add support for PG options as arguments and in the config file, with assorted fixes
2010-04-05 21:17:22 +02:00
Dimitri Fontaine
d63b21c3f9
Update the debian changelog for 2.3.3
2010-04-05 01:07:40 +02:00
Dimitri Fontaine
201209259a
Implement --reject-log and --reject-data options.
2010-04-05 01:02:30 +02:00
Dimitri Fontaine
ac0a16f9b2
Add support for --max-parallel-sections and --section-threads from command line.
2010-04-05 00:32:46 +02:00
Dimitri Fontaine
b7b0bbc62d
Support for processing a filename rather than a section, and add --field-separator
2010-04-04 20:42:40 +02:00
Dimitri Fontaine
99df251963
Adding missed file, parallel data exemple
2010-04-04 19:32:48 +02:00
dim
8af4355994
release 2.3.2
2009-06-29 10:30:46 +00:00
dim
43c95d67c2
python-support is needed for pgloader to run, not only to build
2009-04-28 13:56:37 +00:00
dim
090de905b2
Implement skip_head_lines in configuration file, some more bugfixes
2009-03-10 17:56:16 +00:00
dim
848595f49b
Some more python2.3 support changes
2008-09-18 12:58:12 +00:00
dim
2bacf1a854
FIX RRR bug wrt offsets, allow python 2.3 to run pgloader when it does not need collections.deque (no Round Robin Reader), and prepare packaging for 2.3.2
2008-09-17 16:55:30 +00:00
dim
ea03303e27
Use psycopg cursor.copy_expert() when avaiable (> 2.0.6), which should fix problems tied to too small copy buffer, per Marko's comment on Skytools project
2008-09-05 12:52:18 +00:00
dim
5f335eda28
FIX fixed reader: it now know about -C
2008-09-05 12:50:43 +00:00
dim
094313d7ff
Preliminary support for real line numbers usage in logs, ok for simple cases --- no split_file_reading, multi-line input broken
2008-08-07 22:49:22 +00:00
dim
0e42971ea0
some more facilities in the TODO list
2008-07-27 18:00:43 +00:00
dim
e9fdd8e0b7
FIXES: add -F and -C supports to CSV format, cvs doublequotes defaults to True, per Andrew Dunstan gripes
2008-07-24 16:22:52 +00:00
dim
23b19d381e
debian packaging bug#485067: Missing Build-Depends
2008-06-09 13:25:34 +00:00
dim
85caa89c03
Consider XML support as a TODO item
2008-06-09 13:21:23 +00:00
dim
b1664ae94c
debian package related corrections
2008-06-03 12:58:14 +00:00
dim
ee513ed07a
2.3.1 release
2008-06-03 12:18:17 +00:00
dim
5b8f3b1e2f
Document host setting for Unix Domain Socket connection support
2008-05-29 09:23:27 +00:00
dim
5a63f4f609
Protect the database connection establishing into the parralel sections semaphore, allow field_sep to be configured to \t, and some fixes
2008-05-29 09:16:13 +00:00
dim
d068b05ae2
Build tablename and COPY column list only at COPY time, not for each line
2008-05-28 10:07:45 +00:00
dim
b7c7e6a7c1
Support for fixed format datafile
2008-05-21 10:33:06 +00:00
dim
2d503ad0fa
Close database connection on PGLoader object destruction, and on terminate() too
2008-05-21 07:44:30 +00:00
dim
32874eaede
Typos (proof-read by Simon Riggs, I configured english flyspell to try and spot them all)
2008-03-10 20:18:18 +00:00
dim
0d53197dc8
Avoid including CVSROOT into releases
2008-03-10 15:29:45 +00:00
dim
18a7a48581
update published TODO before release
2008-03-10 15:11:17 +00:00
dim
010629143c
update options.py to VERSION 2.3.0
2008-03-10 14:51:12 +00:00
dim
f13dd16dba
fix the bugfix for cases when field_count is not used (None)
2008-03-10 14:44:02 +00:00
dim
1843c84636
FIX the cluttered example (see BUGS.txt), prepare 2.3.0 packaging
2008-03-10 14:39:38 +00:00
dim
620362bace
cvsignore setting showed forgotten file to add
2008-03-10 13:33:20 +00:00
dim
62f9d5a50b
FIX: PSYCOPG_VERSION defaults to None...
2008-02-27 12:56:18 +00:00
dim
e15ac609a8
Allow user to force psycopg version to use, as psycopg2 is not always the best choice
2008-02-27 12:30:13 +00:00
dim
b47a56bba1
FIX Makefile to ignore some parallel files
2008-02-25 17:26:09 +00:00
dim
a018ddac95
TODO update with status, preparing a debian experimental release
2008-02-25 16:27:07 +00:00
dim
ca2ba09c6a
Fix Makefile archive building
2008-02-25 15:47:18 +00:00
dim
6c86d20c4c
Let's try to keep a record of BUGS
2008-02-25 14:56:10 +00:00