Yes, you definitely can eat mushroom stems! Just make sure to trim off any dried or dirty parts at the bottom of the stem before cooking.