Yes, you can use coconut milk. I have done this. Refer to my drumstick curry with coconut milk recipe. Here you will find the entire process. Trust me, and you will love the coconut milk curry. It’s fantastic.