Fix Bug 89340, ensure config file is always present to avoid 404 and speed up initial load

@lauraxt r?