unitedstates/congress — pull request #140 by konklone (2014-08-01 03:08:06+00:00)
Title: update scrapelib to 0.10, remove follow_robots kwarg

[scrapelib](https://github.com/sunlightlabs/scrapelib) updated to `0.10`, and removed the `follow_robots` parameter and default behavior.

Unfortunately, removing the follow_robots keyword and *not* updating to `0.10` has the effect of enforcing robots.txt checking, which stops this project in its tracks (it depends on ignoring robots.txt).

So after merging, **anyone with this deployed needs to re-run `pip install -r requirements.txt`**.

I'll leave it to a project owner to merge.