small fix to make sure we don't try and remove connection from already freed channel