Try to resolve affine transformation of points.
Mistakenly swapped x,y dims vs. multiplying them by -1 before and after applying the inverse transforms.