Place desired amount of leftover muffins onto a baking sheet, and bake at 350° Fahrenheit until warmed through. You can bake from frozen, or allow leftovers to thaw in the refrigerator and then bake them. Pizza muffins can also be reheated in the toaster oven and, if you're in a rush, the microwave.