kevinelliott/agent_orange — pull request #21 by lencioni (2012-08-05 21:57:26+00:00)
Title: Improve bot detection regex

This commit improves the bot detection regex by:

- adding a number of missing strings, such as alexa, facebookexternalhit,
feedburner, nagios, postrank, pingdom, slurp, and yahoo!
- removing redundant strings such as googlebot and robot (redundant because of
the inclusion of a general "bot" string)
- consolidating similar strings ("crawler" and "crawling" became "crawl(er|ing)")
- alphabetizing the list of bots