We might be able to use _.unique for taking out the dupes (probably right after splitting the dump)