Fail fast if provisioning fails

@brianhw @rocha @benpatterson