Allow spiders.

There's a spider in your ear.
Merge pull request #132 from theodi/allow-indexing

Allow spiders