Bash solution
Setup Ruby project
Crawler
Crawler with Resque
WIP scheduled cron with Ruby