Adding site-verification meta information for google
Adding robots file definitions
Merge pull request #707 from geoadmin/gjn_enable_crawling

Enable SEO crawling on api3