Foods to avoid if you have liver damage include those that are high in fat, sugar, and salt. Alcohol can also contribute to liver damage. Avoid or limit alcohol to no more than one drink a day if you are a woman or two drinks a day for a man.