No you do not need to use the Bourbon in this banana bread. You can simple substitute the Bourbon with milk instead. The bourbon in the batter will be cooked off, but the glaze does contain bourbon that won't be baked off.