Yes, you can absolutely use frozen bananas. Simply let them thaw in their peels, then remove the peels and make sure to include both the bananas and any liquid that’s released during the thawing process. This liquid is packed with flavor and will add extra moisture to your muffins, ensuring they turn out perfectly sweet and tender.