If you leave out any necessary leavening agents or don’t let your banana bread finish cooking, the center will drop. While it might taste good as a gloopy mess of warm banana bread batter nestled within baked bread, it’s not the desired results. Make sure you properly check the bread for doneness before removing it from the oven to cool.