crawler
Merge pull request #1 from stagecoachio/crawler

implemented static and dynamic content crawler