Adding support for Crawlbot and V3 APIs.
Updating readme
Fix typo
Merge pull request #3 from johndavi/master

Added crawlbot support and support for V3 APIs