A holiday favorite, the sweet potato gained popularity in the late 1800s when southerners replaced sweet potatoes with yams. Since then you can find the vegetable in many holiday side dishes and desserts. The main difference between sweet potatoes and yams is their exterior texture, inner coloring, and flavors.