Combine standalone display and upload widget into working entity browser.

That's what defaultConfiguration() of ConfigurablePluginInterface is for. But it doesn't work automatically, you need to merge it in. See BlockBase for example, or ConfigurablePluginBase in search_api.