Clear peer list on destruction