Yes, you absolutely can add more s'mores flavor to your cupcakes by making a hole in the middle and filling it after baking. Try using slightly melted marshmallow fluff to fill the cupcakes and topping it with chocolate or filling your cupcakes with chocolate ganache and topping it with marshmallow creme.