Yes. Scraping out the gills makes room for the filling, improves the mushrooms' texture, and helps reduce excess water. The mushrooms will still release quite a bit of water as you broil them, so once they're done, place them upside down on paper towels to drain.