Remove duplicate text files, clean up new data slightly.