update yaml for robots.txt