github.com/projectdiscovery/Katana (go): A next-generation crawling and spidering framework.
Keywords: cli|crawler|gocrawler|headless|spider-framework|web-spider