This is completely down to personal preference. When baked for almost an hour, the peels will be soft, but if you prefer it without peels, peel them first. In an apple crisp, I prefer the apples peeled. If you make the apple crisp without peeling the apples, be sure to thoroughly wash the apples before cutting.