Track the reference point of broken references to enhance diagnostics