It is ok to keep the thin stems, the stems that are at the top near the leaves. The thicker stems and the bottoms you want to discard. They can be chopped up along with the leaves and used in your dish. If you are using it as a garnish the stems can also add to the look.