Yes, you can make oats with water instead of milk. However, it will taste bland. You can improve the flavor by mixing in a sweetener of your choice.