Mushrooms are best cleaned with a small brush or damp paper towel. You never want to submerge mushrooms fully in water because they will absorb it and become soggy. Gently scrub away any dirt from the top of the mushroom, the mushroom gills, and the stalk, before slicing. If you buy pre-sliced mushrooms, you do not need to clean them.