Export Spiderable symbol, so people can override user agents. Also add twitterbot to agents. Fixes #1300.