The answer to this question depends on the amount of sulfur in the water. While most household water supplies do not have dangerous levels of sulfur, if the level is too high, it can cause stomach pain and nausea. Similarly, high levels of sulfates in the drinking water can be problematic, particularly for infants.