SideCrawl is a simple web spider extensible (via Module) written with Goliath (EventMachine/Ruby).