removed store package
updated crawler.Page to export fields
integrated pages cache into crawler to save visited urls
removed store from crawler.Config
added hack to fix huge channel throughput
moved httpd package to http/event
added godoc to work package
removed crawler.Config
added godoc to scan/html package
rewrote crawler package
Merge pull request #13 from bodokaiser/store

rework store (unduplication) implementation