Add robots.txt and deadlinks.txt