You certainly can. I don't particularly like peach peels so I remove them, but you don't have to.