early version of the deduplicator kinda sorta done