Merge pull request #2 from ayr0/forrest_scrapy

Robots.txt
Finished Revision, rewrote problems
spelling and grammar pass.