upon connection refused allow the application to destroy the connection
after connection tear down was called

Signed-off-by: Eyal Salomon <esalomon@mellanox.com>