holoirc: fix some race conditions and fix up events adding to channel adapter