Capers and olives are both prominent in the Mediterranean and are typically brined or pickled before use, but the olive is larger and grows on a tree while capers grow on smaller bushes. Olives also have stone pits and capers do not.