holoirc: fix many subtle rotation/user list bugs