Sweet potatoes are characterized by their tapered ends and smooth skin, which can vary in color from white to bright orange. In contrast, yams exhibit rough skin and typically have white flesh while having a cylindrical shape. Additionally, yams are starchier and drier compared to sweet potatoes, lacking the sweetness of sweet potatoes.