You can just use water, but you will be missing a lot of the flavor that comes from the broth. If using just water, add additional spices.