Yes, it is perfectly fine to drink water with algae in it. In fact, many people believe that drinking water with algae can have a number of health benefits. Some people believe that it can help detox the body, while others believe that it can help improve digestion and reduce inflammation.