White anchovies should be stored in the refrigerator, preferably in their original packaging or in an airtight container. They can also be stored in the marinade they come in, which helps to preserve their flavor and texture.