Depending on what you use to zest your lemons, you may have gotten some of the pith, too. This tends to give a more bitter flavor. Too much baking soda and baking powder can also make desserts bitter.