Ensuring that buildLayoutXform invalidates DirtyFlags.LocalTransform if changed.
If desired height or width is Infinity, desired will be set as 0,0.