Sweet potatoes can cause constipation when consumed in high quantities. Because they are lower in fiber, and higher in starches, they can worsen constipation in babies that are prone to it. However, you do not need to avoid them completely. Rather serve in moderation, and with other foods for a balanced diet.