You know that you've burnt brown butter if it starts to smell burnt, smoke, or the milk solids in the butter have turned a dark brown or black color.