data ready to merge once dupes are removed