Whether you peel the cucumbers before pickling or leave the skin on is a matter of personal preference. Cucumber skin contains valuable nutrients, including fiber, vitamins, and minerals. By leaving the skin on, you retain these nutrients. However, some cucumber varieties are slightly bitter, especially their skin. Peeling the cucumbers can help reduce any bitterness and result in milder-tasting pickles.