Fix multiaddr race condition when syncing pub keys