If you add too much orange pith with your zest or don't add the correct amount of orange juice or honey, your dish could be bitter. It also could turn bitter if your sauce is overcooked.