Technically you can, but the texture and flavor will be different. It won't be as creamy. Also, the protein and fat in milk help thicken the pudding, so when you don't have either in water, start with just half the liquid.