Do I have to bake the jam in the cupcakes?
No, you can bake the cupcakes, then core out the center and fill it, then cover the top of the hole with the peanut butter frosting when icing the cupcake.