GitHub repository: Croat79/katana
Description: A next-generation crawling and spidering framework.