updated robots.txt was not working on prod