Yes you can. I’d add two tablespoons of melted butter if you won’t be adding the swirl because the batter itself doesn’t contain any butter.