To tell when muffins are baked, watch them in the oven. A golden brown color is a key indicator. You can also insert a clean butter knife or toothpick into the center. If it comes out clean, the muffins are done and can be taken out.