lsmashsource: Avoid calling scaler if not needed.