Only disable the callback we attached to our current value if our current value hasn't yet been garbage collected

There's a small chance that our current value might, in fact, have already been garbage collected but the callback not yet run due to thread scheduling issues and the like. Don't unintentionally prevent it from running in such a case.