Robots.txt rule ammended for target url in scaper
Merge branch 'test'
Merge pull request #8 from sunnyLA4/master

Robots.txt rule ammended for target url in scaper