maxogden/datacouch — Issue #13: Some asshole is uploading tens to hundreds of megabytes of garbage
Author: bvmou
Created: 2011-11-02 02:33:14+00:00
State: open

But he means well.

I have encountered a few problems in attempting to contribute datasets (all data in question available here: [http://bvmou.dyndns.org/_utils/](http://bvmou.dyndns.org/_utils/))

In general, when loading from for example:

http://bvmou.dyndns.org/sf_bike_ped_acc/_design/recline/_rewrite/api/json

I will get prompted to select the "docs" array, will be prompted that it is fetching, will be prompted that it is saving, and then not see the docs reflected in the web interface. It is possible that I am breaking some sort of transfer or cpu limit imposed by iriscouch.

In two cases I successfully loaded (probably excessively) large csv's, with the intention of creating geometries that would be recognizable to a mapping library by editing their field names in the recline interface, but I wasn't able to and instead tried to overwrite them with valid geojson from a local couchdb, leading to the above errors.

Semi-related workaround might be to have a dataset type with sample fields and compressed attachments. For example the 18M attachment "nyacc_newline_separated_geo.tar.gz" at [http://bv.iriscouch.com/_utils/document.html?new_york_accidents/_design/ny_accidents](http://bv.iriscouch.com/_utils/document.html?new_york_accidents/_design/ny_accidents) is something like 255 M uncompressed and ~300 in couch plus several gigs of spatial index. If you are interested in some of these types datasets (not a given), that might be a convenience.