mirror of
https://github.com/dimitri/pgloader.git
synced 2025-08-07 14:56:59 +02:00
01e5c23763
It used to be that you would give the target table name as an option to the PostgreSQL connection string, which is untasteful: load ... into pgsql://user@host/dbname?tablename=foo.bar ... Or even, for backwards compatibility: load ... into pgsql://user@host/dbname?foo.bar ... The new syntax makes provision for a separate clause for the target table name, possibly schema-qualified: load ... into pgsql://user@host/dbname target table foo.bar ... Which is much better, in particular when used together with the target columns clause. Implementing this seemingly quite small feature had impact on many parsing related features of pgloader, such as the regression testing facility. So much so that some extra refactoring got into its way here, around the lisp-code-for-loading-from-<source> functions and their usage in `load-data'. While at it, this patch simplifies a lot the `load-data' function by making a good use of &allow-other-keys and :allow-other-keys t. Finally, this patch splits main.lisp into main.lisp and api.lisp, with the latter intended to contain functions for Common Lisp programs wanting to use pgloader as a library. The API itself is still the same as before this patch, tho. Just in another file for clarity.
52 lines
1.5 KiB
Fish
52 lines
1.5 KiB
Fish
/*
|
|
* The data file comes from the US census website:
|
|
*
|
|
* http://www.census.gov/geo/maps-data/data/gazetteer2013.html
|
|
*
|
|
* We import it directly into pgloader git repository so that we have at
|
|
* least a CSV test where we read from a local file...
|
|
*/
|
|
|
|
LOAD CSV
|
|
FROM data/2013_Gaz_113CDs_national.txt
|
|
HAVING FIELDS
|
|
(
|
|
usps, -- United States Postal Service State Abbreviation
|
|
geoid, -- Geographic Identifier
|
|
aland, -- Land Area (square meters)
|
|
awater, -- Water Area (square meters)
|
|
aland_sqmi, -- SQMI Land Area (square miles)
|
|
awater_sqmi, -- SQMI Water Area (square miles)
|
|
intptlat, -- Latitude (decimal degrees)
|
|
intptlong -- Longitude (decimal degrees)
|
|
)
|
|
|
|
INTO postgresql:///pgloader
|
|
TARGET TABLE districts
|
|
TARGET COLUMNS
|
|
(
|
|
usps, geoid, aland, awater, aland_sqmi, awater_sqmi,
|
|
location point using (format nil "(~a,~a)" intptlong intptlat)
|
|
)
|
|
|
|
WITH truncate,
|
|
disable triggers,
|
|
skip header = 1,
|
|
batch rows = 200,
|
|
batch size = 1024 kB,
|
|
batch concurrency = 3,
|
|
fields terminated by '\t'
|
|
|
|
BEFORE LOAD DO
|
|
$$ drop table if exists districts; $$,
|
|
$$ create table districts (
|
|
usps text,
|
|
geoid text,
|
|
aland bigint,
|
|
awater bigint,
|
|
aland_sqmi double precision,
|
|
awater_sqmi double precision,
|
|
location point
|
|
);
|
|
$$;
|