Added a check for unchanged SFX records and switched to XMLReader to avoid excessive memory consumption during SFX harvesting.
Removed demo publishDate and changed title separator to semicolon in Lido records.
Use mapped format in deduplication. Improved dedup performance. Added support for not shortening dedup title keys starting with any of given strings.
NdlMarcRecord: check for 502 and 509 fields for dissertations and thesis.
Use Gradu instead of ProGradu as the latter would be split in Solr.
Additional index for OAI-PMH providers.