Yes! Just omit the walnuts from the batter and the topping. If you want a crunchy topping, add the sugar with oats or chopped sunflower seed. These are also great when made into chocolate chip banana muffins; swap out the nuts for chocolate.