Lemons are sour but their skin is bitter. If you do not like bitter, only add the lemon slices to flavor the sauce, but do not eat the rind. Another cause of bitter piccata is if the chicken is too brown and adds a burnt or acrid taste to the sauce. Take care to not burn the chicken in step three to prevent this problem.