You should peel them before you cut a parsnip. This not only makes it easier when chopping them up, but the skin actually has a bitter taste to it, which you want to avoid when cooking and serving as you want to enhance the natural sweetness.