Configuration reload doesn't exist yet. When it does, we can easily make one of the intermediary ingesters aware of config reloads.