While the two often get confused, yams and sweet potatoes are actually very different! Yams have a slightly yellow flesh with a brownish skin, while sweet potatoes have a red or orange flesh with a ruddy orange skin. Yams also contain more starch, while sweet potatoes contain less and have a sweeter flavor.