GitHub repository: sebastianczech/crawler
Primary language: Python
Created: 2019-03-14T21:41:07Z
Description: Simple web crawler limited to one domain, which for given URL it visits all pages within the domain and show structured site map.