Yes you can, it will however have a completely different flavour than intended. You can substitute the milk directly for orange juice or with water, or you could even use coconut water.