Ensure order and clean out package generated certs