I don't recommend it, the blend of half and half and heavy cream in this recipe makes the best smoothest texture. If you sub in milk, the texture won't be as rich and will tend to be icy.