add robots.txt, a poorly functioning thor script and a search.json file for the future