Yes, you can overcook and even burn your butter during this process. You'll know it's burnt because it turns into a much darker brown color, far beyond the amber, caramelized look pictures here. Luckily, it's a slow and low technique that wins every time so if you watch carefully you won't burn anything.