metabrainz/coverart_redirect — pull request #4 by ianmcorvidae (2013-01-25 03:22:59+00:00)
Title: Add a robots.txt handling to request.py

Like it says. Just adds a very simple robots.txt.

I'm running into troubles as I poke at adding twitter cards, because it thinks it's not allowed based on our current "robots.txt" that doesn't have real content.