You can allow the peanut butter marshmallow cups to sit at a cool room temperature if you do not prefer to eat your peanut butter cups cold. They will keep at room temperature for a couple of hours but should be refrigerated for longer storage.