Account for original transform of view when swiping