Store-bought marshmallows may often contain xylitol in their ingredients. Hence, some sugar-free marshmallows may contain xylitol or other sugar alcohols as substitutes for the sugar. Xylitol is a natural sweetener that is found in fruits and vegetables. It is safe for people to consume, but it can be harmful to dogs if they eat too much of it.