GitHub repository: pombredanne/reppy
Primary language: Python
Description: Modern robots.txt Parser for Python