vslsmas: Avoid calling scaler if not needed.