While it is technically fine to leave the skin on parsnips, it is best to peel them first unless they are very young. The skin can get quite tough when cooking and isn't as pleasant to eat as the flesh underneath.
While parsnips are quite firm and tough when raw, the skin is thin and papery and very easy to remove with a vegetable peeler.