Improved crawler detection

As discussed here: https://meta.discourse.org/t/noscript-tag-and-some-search-engines/8078/19