The frosting on top of the cupcake will act as the glue for the marshmallows. Be sure to pipe on enough frosting to each cupcake that you can then stick the end of the marshmallow into.