I don't recommend it. Whole milk is best as it adds creaminess without an overwhelming amount of extra dairy fat which can affect the flavor.