Store config in a separate, non tracked file