While you can replace coconut milk with regular dairy milk or another alternative, it would no longer be quite as coconutty. To give it the best coconut flavor, you'll need coconut milk. However, you can use regular milk and add 1 teaspoon of coconut extract if you like.