Yes, you certainly can if you want a tint of lemony taste in your muffins. I recommend adding 1 tablespoon of fresh lemon juice to the muffin batter.