Yes, but frozen bananas will release more liquid after thawing, altering the muffins' texture. Hence, drain the thawed bananas first and then add them to the recipe.