If your lovage plant leaves are turning yellow it could be that your plant is either underwatered or you may have pests such as aphids. It is common for Aphids to siphon the juice out of the leaves causing them to turn yellow.