While reverse osmosis water isn’t perfect, it’s definitely safe to drink. When any water passes through the membrane during the filtering process, the water that comes out of the filter is totally clean and does not contain any impurities.