While I think lemon brings the brightest and best flavor in muffins, yes you can make these with oranges or limes.