Yes! You can replace with half and half to keep to mimic the creaminess from the coconut milk.