Remove identity related files.