Change robots.txt in the hope Baudispider will understand it better.
Added <meta name="robots" content="INDEX, NOFOLLOW"> to pivot report template in the hope to prevent Baudispider web crawler to index logs, as it doesn't understand http://cl-test-grid.appspot.com/robots.txt
Remved unnecessary comment from heroku-compile.lisp
data/README.md: put the example of test results DB on top