Crawler addition
Removed unnecessary files