first pass at a ruby gem for distributed spidering and crawling