Fix hot IB interface attaching and detaching