Yes, you can use frozen bananas for banana chocolate chip muffins. Thaw the bananas completely and drain off any excess liquid before using them in the recipe. The texture of the muffins may be slightly different compared to using fresh bananas, but the flavor should still be delicious.