I recommend you peel apples, as the skin is tough and won't break down on cooking meaning the crumble will have chewy skin peices, which isn't pleasant. Plums on the other hand have a softer skin and are fine to be left on when making a plum crumble.