Enabled multiprocessing for a performance increase.
Mild performance improvements: new field containing md5 hash of filename and index that field to check to see if the news story already exists.