If a configuration is not set, error out properly