Removed the double inverses by in the CB pose by changing the translation vector to the other frame of reference.
Confirmed that what I input as first guess is indeed what comes out of the optimization.