Olives are fruit, not vegetables. They belong to a group of fruit called stone fruits or drupes, such as mangos, cherries, and peaches. A fruit is a part of a plant that contains a seed or a pit.