Olives are both fruits and vegetables. Botanically speaking, they are fruits, as they contain a seed and grow from the flower of a tree. However, they are often classified as vegetables because of their savory taste and culinary uses.