Yes, you can. Just be sure that you pay attention to the baking time, as it will be less for smaller cupcakes.