If the exposure of pregnant women to environmental contaminants that diminish the action of these male hormones has increased over the years , one would expect to see a decrease in the sex difference in birth weight , the researchers said .