is_crawler does exactly what you might think it does: determine if the current request is coming from a crawler or bot.