changing dupe handling method, focusing on reading branch: #msg-13 in progress