remove dedupe functionality