Added twitterbot to useragents

In order to support twitter card urls, twitterbot needs prerendering.