Lemon vinaigrette could be bitter from zesting the white area around the lemon, otherwise known as the "pith." This is bitter in flavor and will make your vinaigrette bitter as well. Try to only zest the yellow most outer layer by continuously moving the zester around the entire surface of the lemon.