While not inherently toxic to a dog, it is possible for them to struggle with swallowing and digesting sweet potato skin.