Improved crawler detection: add Twitterbot, Facebook, curl, Bing, Baidu.
Include opengraph/oembed tags in the crawler layout.
Merge pull request #2128 from vikhyat/crawler-detection

Improved crawler detection