Eliminate duplicate crawls, store history in db if received
Merge pull request #21 from gt-big-data/handle_dup_articles

Handle duplicate articles