Fixed various misc things.

Things fixed:
- robots.txt
- server-generated pages
- visualizations
- api docs
- sitemap

Added:
- analytics
- smoketest to robots.txt
- missing favicon to angular SPA html page.