Don't remove listener in RemoteFinder._destroy.