Heartburn can be relieved by eating ice cream, very cold milk, or water, which is a safe alternative to use during pregnancy.