While you could use olive oil I recommend against it as it will likely alter the taste of the cake. I know some of my readers swear by using olive oil in cake recipes so you can definitely give it a try if you would like.