xmisao/bestgems.org — pull request #9 by xmisao (2014-07-17 13:25:06+00:00)
Title: ignore duplicate scraped data

In rare cases, `scraping_all_gems.rb` stores duplicate data to `scraped_data` table.
Presumably, this phenomenon is caused by increasing number of gems while scraping.
`update_total_downloads.rb` should ignore those duplicate scraped data.