Rebuild internal channel state on the fly if ampersand was not running when the conference started