Remove secrets from application.yml + reset them on provider side