Add a robots.txt file

This robots file allow complete access to the webcrawlers except to the
/search/ folder.
Merge pull request #379 from dcruz/gh-pages

Add a robots.txt file