Added robots.txt, minor code cleanup