There are differing opinions about this, with some people claiming that banana bread is better stored in the refrigerator, and others arguing that just like other quick breads, banana bread should be stored at room temperature. Most food experts agree that banana bread should be stored on the countertop because the fridge can cause it to dry out. If you can't eat it within a few days, store it in the freezer.