As long as the cupcakes are completely cool, you can frost them anytime. Frosting them the night before might save time. And don’t worry about them sitting overnight, frosted cupcakes can be stored at room temperature for up to 3 days.