"So I do not see that the frame is``rotating""around the axis $v $."
it seems to me that your picture imply (in dimension 2) that any compatible connection is torsion free hence the levi-civita connection.