Removed some now useless files
Updated robots.txt