Do not reload group data if not expanded.

In group view.
Reset the loaded flag when refreshing (see #10512)