Don't create the peer object until we can connect to it.