minor progress on removing duplicates