No, the bitterness of the baking soda will disappear as the cake bakes.