Only add certificate & provisioning together

Adding just once triggers the prompt.