changing dupe handling method, focusing on reading branch: #MSG-13 In Progress