Make drag modification of scene matrix working in every scaling case.