Baking soda taste can ultimately ruin baking and the taste does not go away after baking. You might have to neutralize the taste by adding acidic condiment such as vinegar and lemon juice.