Remove the ConnectionManager from the Connection instance