This is likely because of the oil you use.  Some oils have a very strong flavor, which is why we recommend a neutral oil like canola or light olive oil. We also like a blend of olive and neutral oil to make the flavor more subtle.