updated requirements
added robots.txt
Merge branch 'development'
updated robots