add encoding during story checksum to prevent error
fix provider only to generate downloads for active feeds
set default title as (no title)
limit url and guid to 1024 characters
add new downloads and stories indexes
add stories and downloads indexes
add more verbose error for is_new query to debug 'cannot bind reference' error
typo bug
Make processed_stories_id field single valued to enable sort.
Add trigger to processed_stories.
merge sql migrations; list all collection tags on /admin/health
add ignore_schema_version config setting
add ignore_schema_version config setting
various health page related updates, including optimizations and improvements for feed and download lists
fix stories_publish_day typo
many optimizations for the count_words script, including: much faster stemming, threaded line duplicate checking, and much faster unicode compliant tokenization
Restore subroutine MediaWords::Crawler::Provider::_create_download_for_feed() (removed by commit c8d231111f50e62614f16b119a0aaeb5076633f7) because it is being used by unit tests; move said subroutine to MediaWords::Test::DB::create_download_for_feed() because it is being used *only* by unit tests
replace Lingua::Stem with Lingua::Snowball::Stem, with care to make LSS work with threading
small changes to health pages
Merge branch 'master' of github.com:berkmancenter/mediacloud