Yes, you can substitute marshmallow creme with actual marshmallows. Use mini marshmallows and distribute them evenly across the batter for best results. Keep in mind that they will have a slightly different texture.