This is a bit of a personal preference - I leave them on, but trim away the woody bits of mushroom stems (for example, shiitake mushrooms can have very dry, tough ends that are not pleasant to chew, I always cut them to where they feel soft and springy close to the cap.)