Your celery juice will taste much better if you add a green apple, pineapple pieces, lemon, and ginger. Using lemon is the second trick. Although lemon is fantastic and will bring a little bit of that sour flavor to balance some of the celery flavors, you may also use lime.