So, recalculate the size and center point on `mousedown`.  That might work.