A fully baked stuffed mushroom will have a nicely browned top and the cheese will be bubbling. The mushroom should feel tender when pierced with a fork.