Atomically access the weakref here