There is rust in your water supply. While the presence of iron and oxygen in water systems is common, oxidized materials are generally no cause for concern. However, if sediment stays in the lines and sticks to pipe walls, it can damage the linings until a failure occurs. If your faucet or bath water is slightly yellow, it is not harmful to drink. Contact your plumber if there is an unpleasant taste.