Locking the door for bad behaving bots
jspui fix simple search
Merge pull request #764 from bram-atmire/DS-2335

DS-2335 Add more default blocks for certain spiders in robots.txt