namespace cleanup
added the frontier handling
added support for resume crawling
added (tentative) onexit event in order to flush the data (unsuccessful)
new Delete and GetAll methods for the storage
new Crawler class