first run adding removing duplicates based upon ctime