You can, but I'm against it. I'll admit the first time I made this ice cream, we used marshmallows but it just seemed like something was missing. While good, I wanted the gooeyness of melted marshmallows in the ice cream. So I replaced with marshmallow creme and instantly knew this was the recipe. If you have marshmallows, you can just melt and add to create the same texture.