Fix segmentation fault caused by a new connection that is not observer yet.