Improved crawler detection: add Twitterbot, Facebook, curl, Bing, Baidu.
Include opengraph/oembed tags in the crawler layout.