Olive oil will be a bit bitter because of the green olives used in making it. However, olive oil should have a fresh taste and not heavy, oily or exude bitterness. Since olive oil is a monosaturated fat, it should solidify if you put a few tablespoons covered in the fridge. You want the olive oil to be a bit bitter, a little fruity and be a little peppery in flavor.