If you are out of milk, then yes, you can make it using water. In that case, consider adding some vegan yogurt to compensate for the lack of creaminess.