Unless you added too much sour cream and they tasted sour when fresh, it's a clear sign they have gone bad. Milk and dairy products develop a sour smell and taste when they go bad. Mashed potatoes containing dairy will get this sour flavor when they are spoiled. In this case, the safest option is to throw them away.