Although both have a banana flavor, banana cake and banana bread taste much different. Banana cake is softer and moister in texture, while banana bread has a firmer, breadier consistency.