GitHub repository: temoto/robotstxt-go
Primary language: Go
Description: The robots.txt exclusion protocol implementation for Go language #golang