Split up secrets from plain config file