Cleanup after old certs