I recommend peeling them for a smooth and fluffy sweet potato casserole. The skins will peel right off after you boil the potatoes.