Robots.txt added and Apache Alias configs.