Yes, but don't go crazy! It's important to remove the dirt on the mushrooms, but they are super absorbent, so don't immerse them in water or they'll become soggy when cooked. Wipe them well with a damp paper towel and you are good to go.