Use production url
Add robots.txt for search engine optimization