You can bake stuffed mushrooms in the oven without a skillet. Place the stuffed mushrooms on a baking sheet and bake according to the recipe instructions.