Remove services config file and revoke key