umem: fix up unplugging