refactor the crawler
Merge pull request #34 from afeld/crawler-refactor

refactor the crawler