If your leftover potatoes taste sour, take notice. It likely means that your mashed potatoes have gone bad, even if you made them the night before. Remember, severe cases of botulism have long been associated with the consumption of “bad” potatoes. Consuming sour mashed potatoes isn’t worth the risk.