You can, but remember: olive oil changes the flavor. If you're after the classic taste, stick with butter or baking substitutes.