GitHub repository: skeptycal/direct_web_spider
Primary language: Ruby
Description: A direct web spider framworks for Ruby