This is likely caused by burnt caramel bits at the bottom of the saucepan. That's why we recommend using a silicone spatula to scrape down the pan as you stir.