GitHub repository: spyderorg/grobotstxt
Primary language: Go
Description: grobotstxt is a native Go port of Google's robots.txt parser and matcher library.