Add common robot user agents.
Merge pull request #2382 from garthkerr/add-bot-agents

Add common robot user agents.