scraperwiki/scraperwiki_local — pull request #12 by shrikant-joshi (2013-01-06 22:21:53+00:00)
Title: resolves(?) dt.upsert issues

The dumptruck code has undergone a few changes since 0.0.6. The latest version 0.1.1 takes care of a few issues such as IntegrityErrors and 'column not unique' errors during upserts. Beware, though, according to the dumptruck source code, the corrected code is still (somewhat of) a hack and, hence, maybe prone to sql injection.

Optionally, for those trying to scrape html/css from the web are going to need the following two packages installed:
cssselect==0.7.1
lxml==3.1beta1