Fix a segfault on termination of ibverbs connection handler