Yes, you can overcook condensed milk if you’re not too careful. Make sure to stop once your condensed milk has reached the desired consistency and color.