added batch crawl job, which also depends implicitly on local page cache
not tested or fully implemented yet
moved bloomfilter out of page store
rake tasks pass
finish tests before next checkin / push
bloomfilter moved
basisc page store saving will be added
batch crawl job almost ready
making batch job work
basic batch crawling working with simple saving to disk (badly named
files)
batch crawl job implemented