Using too much or too little baking powder or baking soda in proportion to the other ingredients in your recipe could be the reason your banana bread collapses when cooling.