No, you can leave the skin on. As the cobbler cooks, the peaches, including their skin, become really tender, so there's no need to peel them. Unless you want to, of course.