Remove robots specification

Allow search engines to index our site.

Change-Id: Ibd06f2ff9261a8ac624f1700d562ca8c12dd95f0
Add two test machine config files missed in merge

These files are needed for test machine cloudera slaves.

Change-Id: I22906a2169bb44d4207802052edb2d2839897fbe