Cleaning up certs related files.