Remove a double entry