is_crawler does exactly what you might think it does: determine if the supplied string matches a known crawler or bot.