Yes, you can use water instead of milk to make overnight oats. They won't be quite as creamy, although if you add lots of other ingredients (like fresh fruit and other toppings) you probably won't notice.