No, you don't. Some people do not like the texture of the peach skin in baked desserts, but if it doesn't bother you, leave the skin on.