verbs: use disconnect when needed

and don't call rdma_disconnect() and friends except in
our disconnect.