No way! The flavor of the olive oil is definitely there, but this is a very well-balanced recipe, and it's just one layer of flavor. You don't have to worry about this cake tasting like olives or straight olive oil.