Remove a file that should not be there.