Yes! Peaches soften while baking and the skins will naturally fall off leaving an undesirable texture and sometimes bitter flavor.