GitHub repository: AJMansfield/requests-robotstxt
Primary language: Python
Description: Support for robots.txt in a requests Session