Initial checkin. Currently this gets the content at the url requested.
Add recursive crawling and url-munging
Add recursive crawling and url-munging
Add cache for seen urls to prevent re-getting them
Initial checkin of pip requirements
Add instructions, basic explanation
Numerous small changes.
Fix certain relative urls. Add logging. Make regex for crawl targets include src and fix group with it.