replaced a bunch of print statements with log calls
replaced some raw query with django query
fixed deduplication error
merge
some trivial changes to be merged with pull
merge
added script to remove ipage 'articles'
removed IndexDocument from document.py, also removed all references to it in the scrapers
added deduplication to scrape_all_missing.py
re-organised deduplicate.py, all options into one class
some quickfixes
fix deduplicate.py
merge
last fix (hopefully) deduplicate
Added unittest for amcatsolr
Removed / refactored code
Automated merge with https://code.google.com/p/amcat/
pushed in db query that breaks on empty databases (ie all tests)
TestAmcatSolr now passed
Added same timezone as amcatnavigator
add solr stored date check to unit test
merged
improved csv uploader to use medium name and add provenance
Automated merge with https://code.google.com/p/amcat/
Fixing fencepost issue