holoirc: simplify the way buffer handling is done and cleanup