Glass or ceramic containers are much preferred, as they will not react with the vinegar or absorb the flavors of the pickles.