andrewxhill/MOL — Issue #122: Merge PostgreSQL metadata, geometry and Google App Engine metadata exports
Author: gaurav
Created: 2011-10-10 20:01:45+00:00
State: open
Labels: Priority-High, Status-Started

We're going to clean up our bulkloading process and set it up as:

1. For each shapefile:
1. Create metadata CSV (for ALL rows in this shapefile)
2. Bulkload to PostgreSQL (by doing a COPY FROM CSV ...). This will give the rows unique 'id's.
3. Bulkload to Google App Engine (by doing a single COPY TO CSV .. WHERE prov=p, coll=c, filename=f)
4. Run shp2pgis.sql on shapefile -> temp table
5. Update layers table using nested select magic (INSERT INTO layers WHERE .... FROM (SELECT geom FROM TempTable ...))

This issue is just to document the process we're aiming for and for naming the branch :).