Same reason as I mentioned above, we want to switch to `nil` when `reference` is dealloc'd to be atomic.