Fixed the keep-alive and robots.txt settings.