Yes, you can make the rice without the coconut milk. The rice will not have the same creamy texture, but you can prepare the brown rice using 2 cups of water instead of the milk and water in the recipe to cook the 2 cups of rice.