It's fine if a few stems are in the soup, but they leave a bitter taste and are better left out.