Basic crawler functionality
Refactor & enhancements
Progress bar fix
Merge pull request #2 from buren/crawler

Crawler