Properly raise when the config doesn't exist