We no longer have duplicate job listings in our dataset. Remove duplicate detection and write result lazily.