First of all, no you will not taste any baking soda in boiled eggs. Boiling eggs with baking soda helps to lower their pH which loosens them from the shells just enough to make them easier to peel. It’s not entirely necessary, but if you are planning on peeling a lot of eggs you will thank yourself later.