Revert "Added robots.txt"

This reverts commit fc168091ce4044780cf65f03a2bab18b626d874b.
Configuration file comments