Added robots.txt and 404 page.