There are a few reasons why your banana bread muffins might be dense and not fluffy. If you used all-purpose flour instead of self-rising flour, your muffins might not have enough leavening and could be dense. Another possibility is that you overmixed the batter. Be sure to mix the batter just until everything is combined. Overmixing can result in tough, dense muffins.