Yeah, swapping a pointer isn't guaranteed atomic unless you use `sync/atomic`.