I highly recommend adding coconut milk but if for some reason you have to skip it, then it is okay. The taste would not be the same but it still would be a spicy curry. You may have to adjust consistency with water or a non-dairy milk of your choice.