Added graph info and directories to robots.txt
Cleaned up menu, reverted to threehr for main page, added more excludes to robots