Yes, you can use water instead of milk, but the oats may not be as creamy or flavorful.