Revert "LPS-46267 Push the concept of FallbackKeys down to the SettingsFactory. This will allow us to get rid of BaseServiceSettings and generalize the configuration actions."

Pushed to upstream cc/ @izaera