updated estimation for rotation and transition based on the new levenberg marquardt method