GitHub repository: vodafon/waybackrobots
Primary language: Go
Created: 2019-10-07T14:48:51Z
Description: Returns disallowed paths from robots.txt found on your target domain and snapshotted by the Wayback Machine