No. Both caps and stems of mushrooms are edible. If the stems are dry and hard, just slice off (trim) the very ends.