It really depends on your preference! I typically remove them (unless I'm making my apple butter) since the peels can get tough and chewy when baked. I'll typically tell you in the recipe whether you need to peel your apples.