Yes, you can use frozen bananas for muffins, and freezing overripe bananas is a great way to prevent food waste. Peel the overripe bananas and place 2-3 in ziplock bags and freeze until you need them for a recipe.