Yes, you can make this drink without milk. Actually, the authentic recipe in ancient days was made using only water as a liquid base. But eventually, milk was introduced to make the drink richer and creamier. So you can feel free to use water alone or you can also substitute milk with non-dairy milk products to achieve similar results.