Clean up extracted certs directory