add warning about robots.txt file