Added DB functionality and minor changes to Crawler