The surprising answer is yes! I tried it with water, and the chocolate flavor is a bit more intense without the dairy to mellow it, and I really liked it. The pudding doesn't set up quite as thick, so you can add an additional 1-2 teaspoons of cornstarch or flour to make up for that.