Add a robots.txt file

This robots file allow complete access to the webcrawlers except to the
/search/ folder.