Although you technically don't have to, they make it much easier to enjoy your pickles in the end. Otherwise, you'll need to remove the pits while you are eating or before serving your preserves, pickles, or pie filling. It makes much more sense to put in the effort now and enjoy an easier, less tooth-breaking experience later.