duplicate removal code test code added