Map-reduce job that deduplicates lines added