Yes, you certainly can, but the olive oil will prevent the tomato skin from becoming dry and leathery. You can alternatively use vegetable oil instead.