Banana loaf doesn’t usually have icing or frosting added to it while the cake does. While banana loaf can call for heavier flour types such as whole wheat flour and all-purpose flour, banana cake sometimes calls for lighter flours such as pastry flour or cake flour.