spidr (rubygems): Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Keywords: crawler|ruby|scraper|spider|spider-links|web|web-crawler|web-scraper|web-scraping|web-spider