To test if a muffin or cupcake is done, insert a toothpick or cake tester into the center of a muffin. If it comes out with batter on it, it's underbaked and needs more time. If it comes out with a few moist crumbs attached, then the muffins are done baking.