Coconut Milk Ice Cream like my recipe here is dairy free and often vegan as well because it's made with coconut milk. Old Fashioned Coconut Ice Cream is made by infusing coconut into heavy cream and making a custard with eggs and sugar before chilling and freezing it.