You sure can. I don’t recommend submerging them in water for an extended period of time, but a quick rinse and a spin in a salad spinner is a great option for how to clean mushrooms. You can also wipe them down with a clean, damp kitchen towel if you prefer to clean mushrooms that way.