Original: A DA -NETS: F ACE C LUSTERING VIA A DAPTIVE N EIGHBOUR D ISCOVERY IN THE S TRUCTURE S PACE
Revised: A DA -NETS: F ACE C LUSTERING VIA A DAPTIVE N EIGHBOUR D ISCOVERY IN THE S TRUCTURE S PACE

Original: Alibaba xiuyu.sxy@alibaba-inc.com
Revised: Alibaba xiuyu.sxy@alibaba-inc.com

Original: A BSTRACT
Revised: A BSTRACT

Original: Face clustering has attracted rising research interest recently to take advantage of massive amounts of face images on the web.
Revised: Face clustering has attracted rising research interest recently to take advantage of massive amounts of face images on the web.

Original: State-of-the-art performance has been achieved by Graph Convolutional Networks (GCN) due to their powerful representation capacity.
Revised: State-of-the-art performance has been achieved by Graph Convolutional Networks (GCN) due to their powerful representation capacity.

Original: However, existing GCN-based methods build face graphs mainly according to k NN relations in the feature space, which may lead to a lot of noise edges connecting two faces of different classes.
Revised: However, existing GCN-based methods build face graphs mainly according to k NN relations in the feature space, which may lead to a lot of noise edges connecting two faces of different classes.

Original: The face features will be polluted when messages pass along these noise edges, thus degrading the performance of GCNs.
Revised: The face features will be polluted when messages pass along these noise edges, thus degrading the performance of GCNs.

Original: In this paper, a novel algorithm named Ada-NETS is proposed to cluster faces by constructing clean graphs for GCNs.
Revised: In this paper, a novel algorithm named Ada-NETS is proposed to cluster faces by constructing clean graphs for GCNs.

Original: In Ada-NETS, each face is transformed to a new structure space, obtaining robust features by considering face features of the neighbour images.
Revised: In Ada-NETS, each face is transformed to a new structure space, obtaining robust features by considering face features of the neighbour images.

Original: Then, an adaptive neighbour discovery strategy is proposed to determine a proper number of edges connecting to each face image.
Revised: Then, an adaptive neighbour discovery strategy is proposed to determine a proper number of edges connecting to each face image.

Original: It significantly reduces the noise edges while maintaining the good ones to build a graph with clean yet rich edges for GCNs to cluster faces.
Revised: It significantly reduces the noise edges while maintaining the good ones to build a graph with clean yet rich edges for GCNs to cluster faces.

Original: Experiments on multiple public clustering datasets show that Ada-NETS significantly outperforms current state-of-the-art methods, proving its superiority and generalization.
Revised: Experiments on multiple public clustering datasets show that Ada-NETS significantly outperforms current state-of-the-art methods, proving its superiority and generalization.

Original: Code is available at https://github.com/Thomas-wyh/Ada-NETS .
Revised: Code is available at https://github.com/damo-cv/Ada-NETS .

Original:  I NTRODUCTION
Revised:  I NTRODUCTION

Original: The number of images on the web increases rapidly in recent years, a large portion of which are human-centred photos.
Revised: The number of images on the web increases rapidly in recent years, a large portion of which are human-centred photos.

Original: Understanding and managing these photos with little human involvement are demanding, such as associating together photos from a certain person.
Revised: Understanding and managing these photos with little human involvement are demanding, such as associating together photos from a certain person.

Original: A fundamental problem towards these demands is face clustering (Driver & Kroeber, 1932).
Revised: A fundamental problem towards these demands is face clustering (Driver & Kroeber, 1932).

Original: Face clustering has been thoroughly investigated in recent years.
Revised: Face clustering has been thoroughly investigated in recent years.

Original: Significant performance improvements (Wang et al., 2019b; Yang et al., 2019; 2020; Guo et al., 2020;
Revised: Significant performance improvements (Wang et al., 2019b; Yang et al., 2019; 2020; Guo et al., 2020;

Original: Shen et al., 2021) have been obtained with Graph Convolutional Networks due to their powerful feature propagation capacity.
Revised: Shen et al., 2021) have been obtained with Graph Convolutional Networks due to their powerful feature propagation capacity.

Original: The representative DA-Net (Guo et al., 2020) and STAR-FC (Shen et al., 2021) use GCNs to learn enhanced feature embedding by vertices or edges classification tasks to assist clustering.
Revised: The representative DA-Net (Guo et al., 2020) and STAR-FC (Shen et al., 2021) use GCNs to learn enhanced feature embedding by vertices or edges classification tasks to assist clustering.

Original: However, the main problem restricting the power of existing GCN-based face clustering algorithms is the existence of noise edges in the face graphs.
Revised: However, the main problem restricting the power of existing GCN-based face clustering algorithms is the existence of noise edges in the face graphs.

Original: As shown in Figure 1 (b), a noise edge means the connection between two faces of different classes.
Revised: As shown in Figure 1 (b), a noise edge means the connection between two faces of different classes.

Original: Unlike common graph datasets such as Citeseer,
Revised: Unlike common graph datasets such as Citeseer,

Original: Cora and Pubmed with explicit link relation as edges (Kipf & Welling, 2017), face images do not contain explicit structural information, but only deep features extracted from a trained CNN model.
Revised: Cora and Pubmed with explicit link relation as edges (Kipf & Welling, 2017), face images do not contain explicit structural information, but only deep features extracted from a trained CNN model.

Original: Therefore, face images are treated as vertices , and the edges between face images are usually constructed based on the k NN (Cover & Hart, 1967) relations when building the graph: Each face serves
Revised: Therefore, face images are treated as vertices , and the edges between face images are usually constructed based on the k NN (Cover & Hart, 1967) relations when building the graph: Each face serves

Original: [Figure]
Revised: [Figure]

Original: as a probe to retrieve its k nearest neighbours by deep features (Wang et al., 2019b;
Revised: as a probe to retrieve its k nearest neighbours by deep features (Wang et al., 2019b;

Original: Yang et al., 2019; 2020; Guo et al., 2020; Shen et al., 2021).
Revised: Yang et al., 2019; 2020; Guo et al., 2020; Shen et al., 2021).

Original: The k NN relations are not always reliable because deep features are not accurate enough.
Revised: The k NN relations are not always reliable because deep features are not accurate enough.

Original: So the noise edges are introduced to the graph along with the k NN.
Revised: So the noise edges are introduced to the graph along with the k NN.

Original: The noise edges problem is common in face clustering but has received little research attention.
Revised: The noise edges problem is common in face clustering but has received little research attention.

Original: For example, the graph used in (Yang et al., 2020; Shen et al., 2021) contains about 38 .
Revised: For example, the graph used in (Yang et al., 2020; Shen et al., 2021) contains about 38 .

Original: 23% noise edges in testing.
Revised: 23% noise edges in testing.

Original: The noise edges will propagate noisy information between vertices, hurting their features when aggregation, and thus resulting in inferior performance.
Revised: The noise edges will propagate noisy information between vertices, hurting their features when aggregation, and thus resulting in inferior performance.

Original: In Figure 1 (b), the triangular vertex v 1 is connected with three vertices of different classes, and will it be polluted by them with messages passing in the graph.
Revised: In Figure 1 (b), the triangular vertex v 1 is connected with three vertices of different classes, and will it be polluted by them with messages passing in the graph.

Original: Therefore, GCN-based linkage prediction cannot effectively address the noise edges problem in related works (Wang et al., 2019b; Yang et al., 2020;
Revised: Therefore, GCN-based linkage prediction cannot effectively address the noise edges problem in related works (Wang et al., 2019b; Yang et al., 2020;

Original: Shen et al., 2021).
Revised: Shen et al., 2021).

Original: The challenges of removing the noise edges in the face graphs are two-fold as shown in Figure 1 (c) (d).
Revised: The challenges of removing the noise edges in the face graphs are two-fold as shown in Figure 1 (c) (d).

Original: First, the representation ability of deep features is limited in real-world data.
Revised: First, the representation ability of deep features is limited in real-world data.

Original: It is difficult to tell whether two vertices are of the same class solely according to their deep features, thus noise edges are inevitably brought by connecting two vertices of different classes.
Revised: It is difficult to tell whether two vertices are of the same class solely according to their deep features, thus noise edges are inevitably brought by connecting two vertices of different classes.

Original: Second, it is hard to determine how many edges to connect for each vertex when building a graph: Too few edges connected will result in insufficient information aggregation in the graph.
Revised: Second, it is hard to determine how many edges to connect for each vertex when building a graph: Too few edges connected will result in insufficient information aggregation in the graph.

Original: Too many edges connected will increase the number of noise edges, and the vertex feature will be polluted by wrongly connected vertices.
Revised: Too many edges connected will increase the number of noise edges, and the vertex feature will be polluted by wrongly connected vertices.

Original: Although Clusformer (Nguyen et al., 2021) and GAT (Velickovic et al., 2018) try to reduce the impact of the noise edges by the attention mechanism, the connections between various vertices are very complex, and thus it is difficult to find common patterns for the attention weight learning (Yang et al., 2020).
Revised: Although Clusformer (Nguyen et al., 2021) and GAT (Velickovic et al., 2018) try to reduce the impact of the noise edges by the attention mechanism, the connections between various vertices are very complex, and thus it is difficult to find common patterns for the attention weight learning (Yang et al., 2020).

Original: To overcome these tough challenges, the features around each vertex are taken into account because they can provide more information.
Revised: To overcome these tough challenges, the features around each vertex are taken into account because they can provide more information.

Original: Specifically, each vertex feature representation can be improved when considering other vertices nearby.
Revised: Specifically, each vertex feature representation can be improved when considering other vertices nearby.

Original: This is beneficial to address the representation challenge in Figure 1 (c).
Revised: This is beneficial to address the representation challenge in Figure 1 (c).

Original: Then, the number of edges between one vertex and others can be learned from feature patterns around it instead of a manually designed parameter for all vertices.
Revised: Then, the number of edges between one vertex and others can be learned from feature patterns around it instead of a manually designed parameter for all vertices.

Original: This learning method can effectively reduce the connection of noise edges which is crucial to address the second challenge in Figure 1 (d).
Revised: This learning method can effectively reduce the connection of noise edges which is crucial to address the second challenge in Figure 1 (d).

Original: Based on the ideas above, a novel clustering algorithm, named Adaptive
Revised: Based on the ideas above, a novel clustering algorithm, named Adaptive

Original: Neighbour discovEry in the strucTure Space (Ada-NETS), is proposed to handle the noise edges problem for clustering.
Revised: Neighbour discovEry in the strucTure Space (Ada-NETS), is proposed to handle the noise edges problem for clustering.

Original: In Ada-NETS, a structure space is first presented in which vertices can obtain robust features by encoding more texture information after perceiving the data distribution.
Revised: In Ada-NETS, a structure space is first presented in which vertices can obtain robust features by encoding more texture information after perceiving the data distribution.

Original: Then, a candidate neighbours quality criterion is carefully designed to guide building less-noisy yet rich edges, along with a learnable adaptive filter to learn this criterion.
Revised: Then, a candidate neighbours quality criterion is carefully designed to guide building less-noisy yet rich edges, along with a learnable adaptive filter to learn this criterion.

Original: In this way, the neighbours of each vertex are adaptively discovered to build the graph with clean and rich edges.
Revised: In this way, the neighbours of each vertex are adaptively discovered to build the graph with clean and rich edges.

Original: Finally, GCNs take this graph as input to cluster human faces.
Revised: Finally, GCNs take this graph as input to cluster human faces.

Original: The main contributions of this paper are summarized as follows:
Revised: The main contributions of this paper are summarized as follows:

Original: • To the best of our knowledge, this is the first paper to address the noise edges problem when building a graph for GCNs on face images.
Revised: • To the best of our knowledge, this is the first paper to address the noise edges problem when building a graph for GCNs on face images.

Original: Simultaneously, this paper demonstrates its causes, great impact, weaknesses in existing solutions and the challenges to solve it.
Revised: Simultaneously, this paper demonstrates its causes, great impact, weaknesses in existing solutions and the challenges to solve it.

Original: [Figure]
Revised: [Figure]

Original: randomsampling
Revised: randomsampling

Original: G r a ph
Revised: G r a ph

Original: C o n v o l u t i o n a l
Revised: C o n v o l u t i o n a l

Original: N e t w o r k ℒ !"
Revised: N e t w o r k ℒ !"

Original: # 𝛽 !
Revised: # 𝛽 !

Original: −𝛽 !
Revised: −𝛽 !

Original: Hinge Loss 𝑦 " " ," # 𝑦 " " ," # ℒ $%& training
Revised: Hinge Loss 𝑦 " " ," # 𝑦 " " ," # ℒ $%& training

Original: [Figure]
Revised: [Figure]

Original: A d a p t i v e
Revised: A d a p t i v e

Original: F il t e r …
Revised: F il t e r …

Original: [Figure] [Figure]
Revised: [Figure] [Figure]

Original: #$%
Revised: #$%

Original: [Figure]
Revised: [Figure]

Original: 𝜑 𝒗 & 𝜑 𝒗 &
Revised: 𝜑 𝒗 & 𝜑 𝒗 &

Original: [Figure]
Revised: [Figure]

Original: • The proposed Ada-NETS can alleviate the noise edges problem when building a graph on face images, thus improve GCNs greatly to boost clustering performance.
Revised: • The proposed Ada-NETS can alleviate the noise edges problem when building a graph on face images, thus improve GCNs greatly to boost clustering performance.

Original: • State-of-the-art performances are achieved on clustering tasks by Ada-NETS, surpassing the previous ones by a large margin on the face, person, and clothes datasets.
Revised: • State-of-the-art performances are achieved on clustering tasks by Ada-NETS, surpassing the previous ones by a large margin on the face, person, and clothes datasets.

Original:  R ELATED WORK
Revised:  R ELATED WORK

Original: Face Clustering Face clustering tasks often face large-scale samples and complex data distribution, so it has attracted special research attention.
Revised: Face Clustering Face clustering tasks often face large-scale samples and complex data distribution, so it has attracted special research attention.

Original: Classic unsupervised methods are slow and cannot achieve good performances for their naive distribution assumptions, such as convex-shaped data in
Revised: Classic unsupervised methods are slow and cannot achieve good performances for their naive distribution assumptions, such as convex-shaped data in

Original: K-Means (Lloyd, 1982) and similar density of data in DBSCAN (Ester et al., 1996)).
Revised: K-Means (Lloyd, 1982) and similar density of data in DBSCAN (Ester et al., 1996)).

Original: In recent years, GCN-based supervised methods are proved to be effective and efficient for face clustering.
Revised: In recent years, GCN-based supervised methods are proved to be effective and efficient for face clustering.

Original: L-GCN (Wang et al., 2019b) deploys a GCN for linkage prediction on subgraphs.
Revised: L-GCN (Wang et al., 2019b) deploys a GCN for linkage prediction on subgraphs.

Original: DS-GCN (Yang et al., 2019) and VE-GCN (Yang et al., 2020)
Revised: DS-GCN (Yang et al., 2019) and VE-GCN (Yang et al., 2020)

Original: both propose two-stage GCNs for clustering based on the big k NN graph.
Revised: both propose two-stage GCNs for clustering based on the big k NN graph.

Original: DA-Net (Guo et al., 2020) conducts clustering by leveraging non-local context information through density-based graph.
Revised: DA-Net (Guo et al., 2020) conducts clustering by leveraging non-local context information through density-based graph.

Original: Clusformer (Nguyen et al., 2021) clusters faces with a transformer.
Revised: Clusformer (Nguyen et al., 2021) clusters faces with a transformer.

Original: STAR-FC (Shen et al., 2021) develops a structure-preserved sampling strategy to train the edge classification GCN.
Revised: STAR-FC (Shen et al., 2021) develops a structure-preserved sampling strategy to train the edge classification GCN.

Original: These achievements show the power of GCNs in representation and clustering.
Revised: These achievements show the power of GCNs in representation and clustering.

Original: However, the existing methods mostly build face graphs based on k NN, which contain a lot of noise edges.
Revised: However, the existing methods mostly build face graphs based on k NN, which contain a lot of noise edges.

Original: When building these graphs, the similarities between vertices are obtained only according to deep features which are not always accurate, and the number of edges for each vertex is fixed or determined by a similarity threshold.
Revised: When building these graphs, the similarities between vertices are obtained only according to deep features which are not always accurate, and the number of edges for each vertex is fixed or determined by a similarity threshold.

Original: Graph Convolutional Networks GCNs are proposed to deal with non-Euclidean data and have shown their power in learning graph patterns.
Revised: Graph Convolutional Networks GCNs are proposed to deal with non-Euclidean data and have shown their power in learning graph patterns.

Original: It is originally used for transductive semi-supervised learning (Kipf & Welling, 2017) and is extended to inductive tasks by GraphSAGE (Hamilton et al., 2017) that learns the feature aggregation principle.
Revised: It is originally used for transductive semi-supervised learning (Kipf & Welling, 2017) and is extended to inductive tasks by GraphSAGE (Hamilton et al., 2017) that learns the feature aggregation principle.

Original: To further expand the representation power of GCNs, learnable edge weights are introduced to the graph aggregation in the Graph Attention
Revised: To further expand the representation power of GCNs, learnable edge weights are introduced to the graph aggregation in the Graph Attention

Original: Network (GAT) (Velickovic et al., 2018).
Revised: Network (GAT) (Velickovic et al., 2018).

Original: In addition to face clustering, GCNs are also used in many tasks such as skeleton-based action recognition (Yan et al., 2018), knowledge graph (Schlichtkrull et al., 2018) and recommend system (Ying et al., 2018).
Revised: In addition to face clustering, GCNs are also used in many tasks such as skeleton-based action recognition (Yan et al., 2018), knowledge graph (Schlichtkrull et al., 2018) and recommend system (Ying et al., 2018).

Original: However, these methods are proposed on structure data, where the edges are explicitly given.
Revised: However, these methods are proposed on structure data, where the edges are explicitly given.

Original: The GCNs may not perform well on face image datasets if the graph is constructed with a lot of noise edges.
Revised: The GCNs may not perform well on face image datasets if the graph is constructed with a lot of noise edges.

Original:  M ETHODOLOGY
Revised:  M ETHODOLOGY

Original: Face clustering aims to divide a set of face samples into groups so that samples in a group belong to one identity, and any two samples in different groups belong to different identities.
Revised: Face clustering aims to divide a set of face samples into groups so that samples in a group belong to one identity, and any two samples in different groups belong to different identities.

Original: Given a set of feature vectors V = { v 1 , v 2 , ..., v i , ..., v N | v i ∈ R D } extracted from face images by a trained
Revised: Given a set of feature vectors V = { v 1 , v 2 , ..., v i , ..., v N | v i ∈ R D } extracted from face images by a trained

Original: 𝑄 𝑗 𝑣 ! 𝑣 ! !
Revised: 𝑄 𝑗 𝑣 ! 𝑣 ! !

Original: 𝑣 ! "
Revised: 𝑣 ! "

Original: 𝑣 ! # 𝑣 ! $ 𝑣 ! % … $𝐤 "## 𝐤 "## =
Revised: 𝑣 ! # 𝑣 ! $ 𝑣 ! % … $𝐤 "## 𝐤 "## =

Original: Huber Loss 𝜉 ℒ !"
Revised: Huber Loss 𝜉 ℒ !"

Original: #$%
Revised: #$%

Original: Adaptive Filter
Revised: Adaptive Filter

Original: Training
Revised: Training

Original: Testing 𝑣 ! 𝑣 ! !
Revised: Testing 𝑣 ! 𝑣 ! !

Original: 𝑣 ! "
Revised: 𝑣 ! "

Original: 𝑣 ! # 𝑣 ! $ 𝑣 ! % … $𝐤 "## Adaptive Filter neighbours removed candidate neighbours 𝑣 !
Revised: 𝑣 ! # 𝑣 ! $ 𝑣 ! % … $𝐤 "## Adaptive Filter neighbours removed candidate neighbours 𝑣 !

Original: 𝑣 ! !
Revised: 𝑣 ! !

Original: 𝑣 ! "
Revised: 𝑣 ! "

Original: 𝑣 ! # 𝑣 ! $ 𝑣 ! % … probe candidate neighboursof size 𝑘
Revised: 𝑣 ! # 𝑣 ! $ 𝑣 ! % … probe candidate neighboursof size 𝑘

Original: CNN model, the clustering task assigns a group label for each vector v i .
Revised: CNN model, the clustering task assigns a group label for each vector v i .

Original: N is the total number of samples, and D is the dimension of each feature.
Revised: N is the total number of samples, and D is the dimension of each feature.

Original: The Ada-NETS algorithm is proposed as shown in Figure 2 to cluster faces by dealing with the noise edges in face graphs.
Revised: The Ada-NETS algorithm is proposed as shown in Figure 2 to cluster faces by dealing with the noise edges in face graphs.

Original: Firstly, the features are transformed to the proposed structure space for an accurate similarity metric.
Revised: Firstly, the features are transformed to the proposed structure space for an accurate similarity metric.

Original: Then an adaptive neighbour discovery strategy is used to find neighbours for each vertex.
Revised: Then an adaptive neighbour discovery strategy is used to find neighbours for each vertex.

Original: Based on the discovery results, a graph with clean and rich edges is built as the input graph of GCNs for the final clustering.
Revised: Based on the discovery results, a graph with clean and rich edges is built as the input graph of GCNs for the final clustering.

Original: 3. S TRUCTURE SPACE
Revised: 3. S TRUCTURE SPACE

Original: The noise edges problem will lead to the pollution of vertices features, degrading the performance of GCN-based clustering.
Revised: The noise edges problem will lead to the pollution of vertices features, degrading the performance of GCN-based clustering.

Original: It is difficult to determine whether two vertices belong to the same class just based on their deep features, because two vertices of different classes can also have a high similarity, thus introducing noise edges.
Revised: It is difficult to determine whether two vertices belong to the same class just based on their deep features, because two vertices of different classes can also have a high similarity, thus introducing noise edges.

Original: Unfortunately, to the best of our knowledge, almost all existing methods (Wang et al., 2019b;
Revised: Unfortunately, to the best of our knowledge, almost all existing methods (Wang et al., 2019b;

Original: Yang et al., 2020; Guo et al., 2020;
Revised: Yang et al., 2020; Guo et al., 2020;

Original: Shen et al., 2021) build graphs only based on the pairwise cosine similarity between vertices using deep features.
Revised: Shen et al., 2021) build graphs only based on the pairwise cosine similarity between vertices using deep features.

Original: In fact, the similarity metric can be improved by considering the structure information, that is the neighbourhood relationships between images of the dataset.
Revised: In fact, the similarity metric can be improved by considering the structure information, that is the neighbourhood relationships between images of the dataset.

Original: Based on this idea, the concept of the structure space is proposed to tackle this challenge.
Revised: Based on this idea, the concept of the structure space is proposed to tackle this challenge.

Original: In the structure space, the features can encode more texture information by perceiving the data distribution thus being more robust (Zhang et al., 2020).
Revised: In the structure space, the features can encode more texture information by perceiving the data distribution thus being more robust (Zhang et al., 2020).

Original: A transforming function φ is deployed to convert one feature v i into the structure space, noted as v si :
Revised: A transforming function φ is deployed to convert one feature v i into the structure space, noted as v si :

Original: [Equation]
Revised: [Equation]

Original: As shown in Figure 2 (I), with the help of the structure space, for one vertex v i , its similarities with other vertices are computed by the following steps: First, k NN of v i are obtained via an Approximate Nearest-neighbour (ANN) algorithm based on the cosine similarity between v i and the other vertices, noted as N ( v i , k )
Revised: As shown in Figure 2 (I), with the help of the structure space, for one vertex v i , its similarities with other vertices are computed by the following steps: First, k NN of v i are obtained via an Approximate Nearest-neighbour (ANN) algorithm based on the cosine similarity between v i and the other vertices, noted as N ( v i , k )

Original: = { v i 1 , v i 2 , · · · , v i k } .
Revised: = { v i 1 , v i 2 , · · · , v i k } .

Original: Second, motivate by the kernel method (ShaweTaylor & Cristianini, 2004), instead of directly solving the form of φ , we define the similarity of v i to each of its candidates in the structure space by
Revised: Second, motivate by the kernel method (ShaweTaylor & Cristianini, 2004), instead of directly solving the form of φ , we define the similarity of v i to each of its candidates in the structure space by

Original: [Equation]
Revised: [Equation]

Original: where η weights the cosine similarity s cos (cid:0) v i , v i j (cid:1)
Revised: where η weights the cosine similarity s cos (cid:0) v i , v i j (cid:1)

Original: =
Revised: =

Original: [Equation]
Revised: [Equation]

Original: v i ∥ ∥ v ij ∥ and the Jaccard similarity s Jac (cid:0) v i , v i j (cid:1) that is inspired by the common-neighbour-based metric (Zhong et al., 2017).
Revised: v i ∥ ∥ v ij ∥ and the Jaccard similarity s Jac (cid:0) v i , v i j (cid:1) that is inspired by the common-neighbour-based metric (Zhong et al., 2017).

Original: With the definitions above, κ (cid:0) v i , v i j (cid:1) measures the similarity between v i and v i j in the structure space.
Revised: With the definitions above, κ (cid:0) v i , v i j (cid:1) measures the similarity between v i and v i j in the structure space.

Original: 3. A DAPTIVE NEIGHBOUR DISCOVERY
Revised: 3. A DAPTIVE NEIGHBOUR DISCOVERY

Original: The existing methods link edges from naive k NN relations retrieved by deep features (Wang et al., 2019b;
Revised: The existing methods link edges from naive k NN relations retrieved by deep features (Wang et al., 2019b;

Original: Yang et al., 2020; Shen et al., 2021) or using a fixed similarity threshold (Guo et al., 2020).
Revised: Yang et al., 2020; Shen et al., 2021) or using a fixed similarity threshold (Guo et al., 2020).

Original: These methods are all one-size-fits-all solutions and the hyper-parameters have a great impact on the performance.
Revised: These methods are all one-size-fits-all solutions and the hyper-parameters have a great impact on the performance.

Original: To address this issue, the adaptive neighbour discovery module is proposed to learn from the features pattern around each vertex as shown in Figure 2 (II).
Revised: To address this issue, the adaptive neighbour discovery module is proposed to learn from the features pattern around each vertex as shown in Figure 2 (II).

Original: For the vertex v i , its candidate neighbours of size j are the j nearest neighbour vertices based on the similarity of their deep features, where j = 1 , 2 , · · · , k .
Revised: For the vertex v i , its candidate neighbours of size j are the j nearest neighbour vertices based on the similarity of their deep features, where j = 1 , 2 , · · · , k .

Original: Its neighbours mean one specific sized candidate neighbours that satisfy some particular criterion described as follows.
Revised: Its neighbours mean one specific sized candidate neighbours that satisfy some particular criterion described as follows.

Original: The edges between v
Revised: The edges between v

Original: i and all its neighbours are constructed.
Revised: i and all its neighbours are constructed.

Original: 3.2. C ANDIDATE NEIGHBOURS QUALITY CRITERION
Revised: 3.2. C ANDIDATE NEIGHBOURS QUALITY CRITERION

Original: Motivated by the vertex confidence estimation method (Yang et al., 2020), a heuristic criterion is designed to assess the quality of candidate neighbours for each probe vertex.
Revised: Motivated by the vertex confidence estimation method (Yang et al., 2020), a heuristic criterion is designed to assess the quality of candidate neighbours for each probe vertex.

Original: Good neighbours should be clean, i.e., most neighbours should have the same class label with the probe vertex, so that noise edges will not be included in large numbers when building a graph.
Revised: Good neighbours should be clean, i.e., most neighbours should have the same class label with the probe vertex, so that noise edges will not be included in large numbers when building a graph.

Original: The neighbours should also be rich, so that the message can fully pass in the graph.
Revised: The neighbours should also be rich, so that the message can fully pass in the graph.

Original: To satisfy the two principles, the criterion is proposed according to the F β -score (Rijsbergen, 1979) in information retrieval.
Revised: To satisfy the two principles, the criterion is proposed according to the F β -score (Rijsbergen, 1979) in information retrieval.

Original: Similar to visual grammars (Nguyen et al., 2021), all candidate neighbours are ordered by the similarity with the probe vertex in a sequence.
Revised: Similar to visual grammars (Nguyen et al., 2021), all candidate neighbours are ordered by the similarity with the probe vertex in a sequence.

Original: Given candidate neighbours of size j probed by vertex v i , its quality criterion Q ( j ) is defined as:
Revised: Given candidate neighbours of size j probed by vertex v i , its quality criterion Q ( j ) is defined as:

Original: [Equation]
Revised: [Equation]

Original: where Pr j and Rc j are the precision and recall of the first j candidate neighbours with respect to the label of v i .
Revised: where Pr j and Rc j are the precision and recall of the first j candidate neighbours with respect to the label of v i .

Original: β is a weight balancing precision and recall.
Revised: β is a weight balancing precision and recall.

Original: A higher Q -value indicates a better candidate neighbours quality.
Revised: A higher Q -value indicates a better candidate neighbours quality.

Original: 3.2. A DAPTIVE FILTER
Revised: 3.2. A DAPTIVE FILTER

Original: With the criterion above, k off is defined as the heuristic ground truth value of the number of neighbours to choose:
Revised: With the criterion above, k off is defined as the heuristic ground truth value of the number of neighbours to choose:

Original: [Equation]
Revised: [Equation]

Original: As shown in Figure 3, the adaptive filter estimates k off by finding the position of the highest Q -value on the Q -value curve.
Revised: As shown in Figure 3, the adaptive filter estimates k off by finding the position of the highest Q -value on the Q -value curve.

Original: The input of the adaptive filter is the feature vectors [ v i , v
Revised: The input of the adaptive filter is the feature vectors [ v i , v

Original: [Equation]
Revised: [Equation]

Original: , v i
Revised: , v i

Original: [Equation] [Equation]
Revised: [Equation] [Equation]

Original: , , v
Revised: , , v

Original: [Equation]
Revised: [Equation]

Original: [Equation] [Equation]
Revised: [Equation] [Equation]

Original: +
Revised: +

Original: [Equation]
Revised: [Equation]

Original: ) × D .
Revised: ) × D .

Original: In training, given a mini-batch with B sequences, adaptive filter is trained using the Huber loss (Huber, 1992):
Revised: In training, given a mini-batch with B sequences, adaptive filter is trained using the Huber loss (Huber, 1992):

Original: [Equation]
Revised: [Equation]

Original: , where L Huber b = (cid:26) 12 ξ 2 , ξ < δ,
Revised: , where L Huber b = (cid:26) 12 ξ 2 , ξ < δ,

Original: [Equation]
Revised: [Equation]

Original: − 12 δ 2 , otherwise ,
Revised: − 12 δ 2 , otherwise ,

Original: [Equation]
Revised: [Equation]

Original: =
Revised: =

Original: [Equation]
Revised: [Equation]

Original: b | k
Revised: b | k

Original: [Equation]
Revised: [Equation]

Original: b ,
Revised: b ,

Original: [Equation]
Revised: [Equation]

Original: 5) ˆ k off b is the prediction of k off b , and δ is an outlier threshold.
Revised: 5) ˆ k off b is the prediction of k off b , and δ is an outlier threshold.

Original: With each prediction ˆ k off from ˆ k off b , the candidate neighbours with orders beyond ˆ k off are removed and the left will be treated as neighbours of the corresponding probe.
Revised: With each prediction ˆ k off from ˆ k off b , the candidate neighbours with orders beyond ˆ k off are removed and the left will be treated as neighbours of the corresponding probe.

Original: The adaptive filter is implemented as a bi-directional LSTM (Schuster & Paliwal, 1997; Graves & Schmidhuber, 2005) and two Fully-Connected layers with shortcuts.
Revised: The adaptive filter is implemented as a bi-directional LSTM (Schuster & Paliwal, 1997; Graves & Schmidhuber, 2005) and two Fully-Connected layers with shortcuts.

Original: 3. A DA -NETS FOR FACE CLUSTERING
Revised: 3. A DA -NETS FOR FACE CLUSTERING

Original: To effectively address the noise edges problem in face clustering, Ada-NETS first takes advantage of the proposed structure space and adaptive neighbour discovery to build a graph with clean and rich edges.
Revised: To effectively address the noise edges problem in face clustering, Ada-NETS first takes advantage of the proposed structure space and adaptive neighbour discovery to build a graph with clean and rich edges.

Original: Then a GCN model is used to complete the clustering in this graph as shown in Figure 2 (III).
Revised: Then a GCN model is used to complete the clustering in this graph as shown in Figure 2 (III).

Original: With similarity metric in the structure space and adaptive neighbour discovery method above, the discovered neighbours of vertex v i is denoted as N s ( v i , k ) :
Revised: With similarity metric in the structure space and adaptive neighbour discovery method above, the discovered neighbours of vertex v i is denoted as N s ( v i , k ) :

Original: [Equation]
Revised: [Equation]

Original: (6) where Ind j means the index of v i j ranked by κ (cid:0) v i , v i j (cid:1) in the descending order.
Revised: (6) where Ind j means the index of v i j ranked by κ (cid:0) v i , v i j (cid:1) in the descending order.

Original: Based on these neighbour relations, an undirected graph G ( F , A ) is generated by linking an edge between two vertices if any of which is the discovered neighbour of the other.
Revised: Based on these neighbour relations, an undirected graph G ( F , A ) is generated by linking an edge between two vertices if any of which is the discovered neighbour of the other.

Original: F =
Revised: F =

Original: [ v 1 , v 2 , · · · , v N ] T is the vertex feature matrix, and A is the adjacency matrix:
Revised: [ v 1 , v 2 , · · · , v N ] T is the vertex feature matrix, and A is the adjacency matrix:

Original: [Equation]
Revised: [Equation]

Original: With the built graph G ( F , A ) , A GCN model is used to learn whether two vertices belong to the same class.
Revised: With the built graph G ( F , A ) , A GCN model is used to learn whether two vertices belong to the same class.

Original: One GCN layer is defined as:
Revised: One GCN layer is defined as:

Original: [Equation]
Revised: [Equation]

Original: where ˜A =
Revised: where ˜A =

Original: A + I ,
Revised: A + I ,

Original: I ∈
Revised: I ∈

Original: R N × N is an identity matrix, ˜D is the diagonal degree matrix that ˜D ii =
Revised: R N × N is an identity matrix, ˜D is the diagonal degree matrix that ˜D ii =

Original: (cid:80)
Revised: (cid:80)

Original: Nj =

Revised: Nj =

Original: ˜A i,j , F l and W l are respectively the input feature matrix and weight matrix of l -th layer, and σ ( · ) is an activation function.
Revised: ˜A i,j , F l and W l are respectively the input feature matrix and weight matrix of l -th layer, and σ ( · ) is an activation function.

Original: Two GCN layers are used in this paper, followed with one FC layer with PReLU (He et al., 2015) activation and one normalization.
Revised: Two GCN layers are used in this paper, followed with one FC layer with PReLU (He et al., 2015) activation and one normalization.

Original: For a batch of randomly sampled vertices B v , the training loss is defined as a variant version of Hinge loss (Rosasco et al., 2004):
Revised: For a batch of randomly sampled vertices B v , the training loss is defined as a variant version of Hinge loss (Rosasco et al., 2004):

Original: [Equation]
Revised: [Equation]

Original: where L pos =
Revised: where L pos =

Original: ∥ l i =
Revised: ∥ l i =

Original: l j ∥ (cid:88)
Revised: l j ∥ (cid:88)

Original: [Equation]
Revised: [Equation]

Original: =
Revised: =

Original: l j
Revised: l j

Original: [Equation]
Revised: [Equation]

Original: (9) where y v i , v j is the cosine similarity of the GCN output features v ′
Revised: (9) where y v i , v j is the cosine similarity of the GCN output features v ′

Original: i and v ′ j of the two vertices v i and v j in the batch B v , [ · ] + = max (0 , · ) , ∥ l i =
Revised: i and v ′ j of the two vertices v i and v j in the batch B v , [ · ] + = max (0 , · ) , ∥ l i =

Original: l j ∥ is the number of the positive pairs, i.e., the ground-truth label l i of v i and the ground-truth label l j of v j are the same; β 1 and β 2 are the margins of the positive and negative losses, and λ is the weight balancing the two losses.
Revised: l j ∥ is the number of the positive pairs, i.e., the ground-truth label l i of v i and the ground-truth label l j of v j are the same; β 1 and β 2 are the margins of the positive and negative losses, and λ is the weight balancing the two losses.

Original: During inference, the whole graph of test data is input into GCN to obtain enhanced features F ′
Revised: During inference, the whole graph of test data is input into GCN to obtain enhanced features F ′

Original: =
Revised: =

Original: [ v ′ 1 , v ′ 2 , · · · , v ′ N ] T ∈ R N × D ′ for all vertices, where D ′ is the dimension of each new feature.
Revised: [ v ′ 1 , v ′ 2 , · · · , v ′ N ] T ∈ R N × D ′ for all vertices, where D ′ is the dimension of each new feature.

Original: Pairs of vertices are linked when their similarity scores are larger than a predefined threshold θ .
Revised: Pairs of vertices are linked when their similarity scores are larger than a predefined threshold θ .

Original: Finally, clustering is done by merging all links transitively with the union-find algorithm, i.e., waitfree parallel algorithms(Anderson & Woll, 1991).
Revised: Finally, clustering is done by merging all links transitively with the union-find algorithm, i.e., waitfree parallel algorithms(Anderson & Woll, 1991).

Original:  E XPERIMENTS 4. E VALUATION METRICS , DATASETS , AND EXPERIMENTAL SETTINGS
Revised:  E XPERIMENTS 4. E VALUATION METRICS , DATASETS , AND EXPERIMENTAL SETTINGS

Original: The Signal-Noise Rate (SNR) and Q -value are used to directly evaluate the quality of graph building, where SNR is the ratio of the number of correct edges and noise edges in the graph.
Revised: The Signal-Noise Rate (SNR) and Q -value are used to directly evaluate the quality of graph building, where SNR is the ratio of the number of correct edges and noise edges in the graph.

Original: BCubed Fscore F B (Bagga & Baldwin, 1998; Amig ´ o et al., 2009) and Pairwise F-score F P (Shi et al., 2018) are used to evaluate the final clustering performance.
Revised: BCubed Fscore F B (Bagga & Baldwin, 1998; Amig ´ o et al., 2009) and Pairwise F-score F P (Shi et al., 2018) are used to evaluate the final clustering performance.

Original: Three datasets are used in the experiments:
Revised: Three datasets are used in the experiments:

Original: MS-Celeb-1M (Guo et al., 2016;
Revised: MS-Celeb-1M (Guo et al., 2016;

Original: Deng et al., 2019) is a large-scale face dataset with about 5.8M face images of 86K identities after data cleaning.
Revised: Deng et al., 2019) is a large-scale face dataset with about 5.8M face images of 86K identities after data cleaning.

Original: For a fair comparison, we follow the same protocol and features as VE-GCN (Yang et al., 2019) to divide the dataset evenly into ten parts by identities, and use part 0 as the training set and part 1 to partas the testing set.
Revised: For a fair comparison, we follow the same protocol and features as VE-GCN (Yang et al., 2019) to divide the dataset evenly into ten parts by identities, and use part 0 as the training set and part 1 to partas the testing set.

Original: In addition to the face data, Ada-NETS has also been evaluated for its potential in clustering other objects.
Revised: In addition to the face data, Ada-NETS has also been evaluated for its potential in clustering other objects.

Original: The clothes dataset DeepFashion (Liu et al., 2016) is used with the same subset, split settings and features as VE-GCN (Yang et al., 2020), where there are 25,752 images of 3,997 categories for training, and 26,960 images of 3,984 categories for testing.
Revised: The clothes dataset DeepFashion (Liu et al., 2016) is used with the same subset, split settings and features as VE-GCN (Yang et al., 2020), where there are 25,752 images of 3,997 categories for training, and 26,960 images of 3,984 categories for testing.

Original: MSMT17 (Wei et al., 2018) is the current largest ReID dataset widely used (Chen et al., 2021; Jiang et al., 2021).
Revised: MSMT17 (Wei et al., 2018) is the current largest ReID dataset widely used (Chen et al., 2021; Jiang et al., 2021).

Original: Its images are captured under different weather, light conditions and time periods from 15 cameras, which are challenging for clustering.
Revised: Its images are captured under different weather, light conditions and time periods from 15 cameras, which are challenging for clustering.

Original: There are 32,621 images of 1,041 individuals for training and 93,820 images of 3,060 individuals for testing.
Revised: There are 32,621 images of 1,041 individuals for training and 93,820 images of 3,060 individuals for testing.

Original: Features are obtained from a model trained on the training set (He et al., 2020).
Revised: Features are obtained from a model trained on the training set (He et al., 2020).

Original: The learning rate is initially 0.01 for training the adaptive filter and 0.1 for training the GCN with cosine annealing.
Revised: The learning rate is initially 0.01 for training the adaptive filter and 0.1 for training the GCN with cosine annealing.

Original: δ = 1 for Huber loss, β 1 = 0 .
Revised: δ = 1 for Huber loss, β 1 = 0 .

Original: 9 , β 2 = 1 . 0 , λ = 1 for Hingle loss and β = 0 .for
Revised: 9 , β 2 = 1 . 0 , λ = 1 for Hingle loss and β = 0 .for

Original: Q -value.
Revised: Q -value.

Original: The SGD optimizer with momentum 0.9 and weight decay 1e-5 is used.
Revised: The SGD optimizer with momentum 0.9 and weight decay 1e-5 is used.

Original: k is set 80 , 5 , 40 on MS-Celeb-1M , DeepFashion , and MSMT17 .
Revised: k is set 80 , 5 , 40 on MS-Celeb-1M , DeepFashion , and MSMT17 .

Original: The experiments are conducted with
Revised: The experiments are conducted with

Original: PyTorch (Paszke et al., 2019) and DGL (Wang et al., 2019a).
Revised: PyTorch (Paszke et al., 2019) and DGL (Wang et al., 2019a).

Original: [Table] [Table]
Revised: [Table] [Table]

Original: [Table] [Table]
Revised: [Table] [Table]

Original: M ETHOD COMPARISON
Revised: M ETHOD COMPARISON

Original: Face clustering performance is evaluated on the MS-Celeb-1M dataset with different numbers of unlabeled images.
Revised: Face clustering performance is evaluated on the MS-Celeb-1M dataset with different numbers of unlabeled images.

Original: Comparison approaches include classic clustering methods K-Means (Lloyd, 1982), HAC (Sibson, 1973), DBSCAN (Ester et al., 1996), and graph-based methods L-GCN (Wang et al., 2019b), DS-GCN (Yang et al., 2019), VE-GCN (Yang et al., 2020),
Revised: Comparison approaches include classic clustering methods K-Means (Lloyd, 1982), HAC (Sibson, 1973), DBSCAN (Ester et al., 1996), and graph-based methods L-GCN (Wang et al., 2019b), DS-GCN (Yang et al., 2019), VE-GCN (Yang et al., 2020),

Original: DA-Net (Guo et al., 2020), Clusformer (Nguyen et al., 2021) and STAR-FC (Shen et al., 2021).
Revised: DA-Net (Guo et al., 2020), Clusformer (Nguyen et al., 2021) and STAR-FC (Shen et al., 2021).

Original: In this section, to further enhance the clustering performance of GCNs, some noise is added to the training graph.
Revised: In this section, to further enhance the clustering performance of GCNs, some noise is added to the training graph.

Original: Results in Table 1 show that the proposed Ada-NETS reaches the best performance in all tests ( θ = 0 . 96 ), outperforming STAR-FC by 1.19% to reach 91.40% BCubed F-score on 584K unlabeled data.
Revised: Results in Table 1 show that the proposed Ada-NETS reaches the best performance in all tests ( θ = 0 . 96 ), outperforming STAR-FC by 1.19% to reach 91.40% BCubed F-score on 584K unlabeled data.

Original: With the increase in the number of unlabeled images, the proposed Ada-NETS keeps superior performance, revealing the significance of graph building in large-scale clustering.
Revised: With the increase in the number of unlabeled images, the proposed Ada-NETS keeps superior performance, revealing the significance of graph building in large-scale clustering.

Original: To further evaluate the generalization ability of our approach in non-face clustering tasks, comparisons are also conducted on DeepFashion and MSMT17 .
Revised: To further evaluate the generalization ability of our approach in non-face clustering tasks, comparisons are also conducted on DeepFashion and MSMT17 .

Original: As shown in Table 2, Ada-NETS achieves the best performance in the clothes and person clustering tasks.
Revised: As shown in Table 2, Ada-NETS achieves the best performance in the clothes and person clustering tasks.

Original: 4. A BLATION STUDY
Revised: 4. A BLATION STUDY

Original: Study on the structure space and adaptive neighbour discovery Table 3 evaluates the contributions of the structure space and adaptive neighbour discovery.
Revised: Study on the structure space and adaptive neighbour discovery Table 3 evaluates the contributions of the structure space and adaptive neighbour discovery.

Original: The SNR of the built graph and the
Revised: The SNR of the built graph and the

Original: BCubed and Pairwise F-scores are compared.
Revised: BCubed and Pairwise F-scores are compared.

Original: It is observed that the structure space and adaptive neighbour discovery both contribute to the performance improvement, between which the adaptive neighbour discovery contributes more.
Revised: It is observed that the structure space and adaptive neighbour discovery both contribute to the performance improvement, between which the adaptive neighbour discovery contributes more.

Original: With both components, the graph’s SNR is largely enhanced
Revised: With both components, the graph’s SNR is largely enhanced

Original: [Figure]
Revised: [Figure]

Original: [Table]
Revised: [Table]

Original: Ori
Revised: Ori

Original: [Table] [Table]
Revised: [Table] [Table]

Original: by 13.38 times, and the clustering performance is also largely improved.
Revised: by 13.38 times, and the clustering performance is also largely improved.

Original: Each line in Figureshows the discovery results with the first image as the probe, ranked by the similarity in the structure space.
Revised: Each line in Figureshows the discovery results with the first image as the probe, ranked by the similarity in the structure space.

Original: The images with a blue circle are of the same identity as the probe.
Revised: The images with a blue circle are of the same identity as the probe.

Original: They all successfully obtain greater similarity in the structure space than those with a red triangle that represents different identities.
Revised: They all successfully obtain greater similarity in the structure space than those with a red triangle that represents different identities.

Original: With the help of the adaptive filter, images after the yellow vertical line are filtered out, remaining clean and rich neighbours.
Revised: With the help of the adaptive filter, images after the yellow vertical line are filtered out, remaining clean and rich neighbours.

Original: Without the adaptive filter, the images with a red triangle will be connected with its probe, leading to pollution of the probe.
Revised: Without the adaptive filter, the images with a red triangle will be connected with its probe, leading to pollution of the probe.

Original: Study on the quality criterion According to Equation
Revised: Study on the quality criterion According to Equation

Original: [Table]
Revised: [Table]

Original: the criterion contains a hyper-parameter β .
Revised: the criterion contains a hyper-parameter β .

Original: Smaller β emphasizes more on precision, and bigger β emphasizes more on recall.
Revised: Smaller β emphasizes more on precision, and bigger β emphasizes more on recall.

Original: We choose three mostly-used values β ∈ { 0 . 5 , 1 . 0 , 2 . 0 } to study how it affects the neighbour discovery and clustering.
Revised: We choose three mostly-used values β ∈ { 0 . 5 , 1 . 0 , 2 . 0 } to study how it affects the neighbour discovery and clustering.

Original: Table 4 shows the performance of Ada-NETS under different β in the original (denoted as
Revised: Table 4 shows the performance of Ada-NETS under different β in the original (denoted as

Original: Ori.) and structure space (denoted as Str.).
Revised: Ori.) and structure space (denoted as Str.).

Original: Q before and Q after are the Q -value of candidate neighbours of size k and k off .
Revised: Q before and Q after are the Q -value of candidate neighbours of size k and k off .

Original: F P and F B are the corresponding clustering performance under k off .
Revised: F P and F B are the corresponding clustering performance under k off .

Original: It is observed that Q after is obviously improved compared with Q before in all circumstance.
Revised: It is observed that Q after is obviously improved compared with Q before in all circumstance.

Original: For the same β , the improvements are more obvious in the structure space than in the original space.
Revised: For the same β , the improvements are more obvious in the structure space than in the original space.

Original: As analysed above, a higher Q -value indicates a better candidate neighbours quality, e.g., more noise edges will be eliminated (clean) or more correct edges will be kept (rich) in the graph.
Revised: As analysed above, a higher Q -value indicates a better candidate neighbours quality, e.g., more noise edges will be eliminated (clean) or more correct edges will be kept (rich) in the graph.

Original: Therefore, the clustering performance in the structure space is also higher than in the original space as is expected.
Revised: Therefore, the clustering performance in the structure space is also higher than in the original space as is expected.

Original: In addition, β = 0 .
Revised: In addition, β = 0 .

Original: 5 achieves the best clustering performance in both spaces while much less sensitive in the structure space to reach 95.51% Pairwise F-score and 94.93% BCubed F-score.
Revised: 5 achieves the best clustering performance in both spaces while much less sensitive in the structure space to reach 95.51% Pairwise F-score and 94.93% BCubed F-score.

Original: Study on the adaptive filter Adaptive filter is proposed to select neighbours from candidate neighbours.
Revised: Study on the adaptive filter Adaptive filter is proposed to select neighbours from candidate neighbours.

Original: Compared with the estimation method to regress k off directly in the adaptive filter, noted as
Revised: Compared with the estimation method to regress k off directly in the adaptive filter, noted as

Original: E kreg , some other estimation methods are also studied: E kcls formulates the k off estimation as a kclass classification task; E Qseq regresses Q -value for all j directly; E Qparam fits Q -value with respect to j with a quadratic curve and estimates the parameters of this curve.
Revised: E kreg , some other estimation methods are also studied: E kcls formulates the k off estimation as a kclass classification task; E Qseq regresses Q -value for all j directly; E Qparam fits Q -value with respect to j with a quadratic curve and estimates the parameters of this curve.

Original: Results in Table 5 show that
Revised: Results in Table 5 show that

Original: E kreg and E kcls that estimate k off obtain obviously higher performance than E Qseq and E Qparam that estimate the Q -value.
Revised: E kreg and E kcls that estimate k off obtain obviously higher performance than E Qseq and E Qparam that estimate the Q -value.

Original: Compared with E k cls , E kreg achieves close results but needs less parameters
Revised: Compared with E k cls , E kreg achieves close results but needs less parameters

Original: [Figure]
Revised: [Figure]

Original: discovery to learn.
Revised: discovery to learn.

Original: GAT is also compared to eliminate noise edges by the attention mechanism, but does not obtain competitive results because of the complex feature pattern (Yang et al., 2020).
Revised: GAT is also compared to eliminate noise edges by the attention mechanism, but does not obtain competitive results because of the complex feature pattern (Yang et al., 2020).

Original: Study on the sensitivity to k Figure 5 (a) shows the clustering performance with the variance of k .
Revised: Study on the sensitivity to k Figure 5 (a) shows the clustering performance with the variance of k .

Original: “ k NN” represents directly selecting the nearest k neighbours to build the graph as in existing methods (Yang et al., 2020; Shen et al., 2021) and “Structure k NN” represents selecting k NN in the structure space with N ( v , 256) .
Revised: “ k NN” represents directly selecting the nearest k neighbours to build the graph as in existing methods (Yang et al., 2020; Shen et al., 2021) and “Structure k NN” represents selecting k NN in the structure space with N ( v , 256) .

Original: Despite the help in the structure space, the two k NN methods are all sensitive to k since more noise edges are included when k increases.
Revised: Despite the help in the structure space, the two k NN methods are all sensitive to k since more noise edges are included when k increases.

Original: The “Threshold” and “Chain Sim” method are also also sensitive to the number of candidate neighbours and have not achieved good results.
Revised: The “Threshold” and “Chain Sim” method are also also sensitive to the number of candidate neighbours and have not achieved good results.

Original: The details of each method can be found in Table 9 in appendix.
Revised: The details of each method can be found in Table 9 in appendix.

Original: However, the proposed Ada-NETS can relatively steadily obtain good performance, showing that our method can effectively provide clean and rich neighbours to build the graph for GCNs.
Revised: However, the proposed Ada-NETS can relatively steadily obtain good performance, showing that our method can effectively provide clean and rich neighbours to build the graph for GCNs.

Original: Study on the graph embedding
Revised: Study on the graph embedding

Original: In Ada-NETS, GCN is used to produce more compactly distributed features, thus more suitable for clustering.
Revised: In Ada-NETS, GCN is used to produce more compactly distributed features, thus more suitable for clustering.

Original: ROC curves of one billion randomly selected pairs are shown in Figure 5 (b).
Revised: ROC curves of one billion randomly selected pairs are shown in Figure 5 (b).

Original: It is observed that the original feature embedding (OFE) obtains the worst ROC performance, and the graph embedding (GE) output by the GCN is enhanced by a large margin.
Revised: It is observed that the original feature embedding (OFE) obtains the worst ROC performance, and the graph embedding (GE) output by the GCN is enhanced by a large margin.

Original: With the help of the adaptive neighbour discovery (GE + AND), the output feature is more discriminating.
Revised: With the help of the adaptive neighbour discovery (GE + AND), the output feature is more discriminating.

Original: When the discovery is applied in the structure space (GE + AND + SS), GCN can output the most discriminating features.
Revised: When the discovery is applied in the structure space (GE + AND + SS), GCN can output the most discriminating features.

Original: Distributions of embeddings after dimensionality reduction via PCA (Pearson, 1901) of ten randomly selected identities are shown in Figure 5 (c).
Revised: Distributions of embeddings after dimensionality reduction via PCA (Pearson, 1901) of ten randomly selected identities are shown in Figure 5 (c).

Original: It is observed that the better ROC performance a kind of feature embedding has in Figure 5 (b), the more compact its embeddings are for a certain identity.
Revised: It is observed that the better ROC performance a kind of feature embedding has in Figure 5 (b), the more compact its embeddings are for a certain identity.

Original: With better features embeddings, the clustering can be started again.
Revised: With better features embeddings, the clustering can be started again.

Original: These discriminating graph embeddings of “GE + AND + SS” are used as the input of

Original: Ada-NETS to get the final clustering results for enhancement ( θ = 0 . 99 ).

Original: In Table 10 of appendix, the clustering results on MS-Celeb-1M are compared with the ones using original feature embeddings.
Revised: In Table 10 of appendix, the clustering results on MS-Celeb-1M are compared with the ones using original feature embeddings.

Original: It is observed that the graph embeddings further enhance Ada-NETS from state-of-the-art to a remarkable 93.74% on F P , achieving nearly 1% improvement on 584K unlabeled data again.
Revised: It is observed that the graph embeddings further enhance Ada-NETS. The details are described in Section A.8 of appendix.

Original:  C ONCLUSION
Revised:  C ONCLUSION

Original: This paper presents a novel Ada-NETS algorithm to deal with the noise edges problem when building the graph in GCN-based face clustering.
Revised: This paper presents a novel Ada-NETS algorithm to deal with the noise edges problem when building the graph in GCN-based face clustering.

Original: In Ada-NETS, the features are first transformed to the structure space to enhance the accuracy of the similarity metrics.
Revised: In Ada-NETS, the features are first transformed to the structure space to enhance the accuracy of the similarity metrics.

Original: Then an adaptive neighbour discovery method is used to find neighbours for all samples adaptively with the guidance of a heuristic quality criterion.
Revised: Then an adaptive neighbour discovery method is used to find neighbours for all samples adaptively with the guidance of a heuristic quality criterion.

Original: Based on the discovered neighbour relations, a graph with clean and rich edges is built as the input of GCNs to obtain state-of-the-art on the face, clothes, and person clustering tasks.
Revised: Based on the discovered neighbour relations, a graph with clean and rich edges is built as the input of GCNs to obtain state-of-the-art on the face, clothes, and person clustering tasks.

Revised: Acknowledgement This work was supported by Alibaba Group through Alibaba Innovative Research Program.

Original: A A PPENDIX
Revised: A A PPENDIX

Original: In this appendix, we present the supplementary information on 1) the calculations of the precision and recall; 2) the calculation of the Jaccard similarity; 3) the detailed description of different designs of the adaptive filter; 4) the baseline results of selecting neighbours by various thresholds based on the cosine similarity of deep features; 5) the baseline results of directly clustering on the built graph without GCNs; 6) the time-consuming analysis of Ada-NETS.
Revised: In this appendix, we present the supplementary information on 1) the calculations of the precision and recall; 2) the calculation of the Jaccard similarity; 3) the detailed description of different designs of the adaptive filter; 4) the baseline results of selecting neighbours by various thresholds based on the cosine similarity of deep features; 5) the baseline results of directly clustering on the built graph without GCNs; 6) the time-consuming analysis of Ada-NETS.

Original: A. P RECISION AND RECALL
Revised: A. P RECISION AND RECALL

Original: In the paper, precision Pr j and recall Rc j are used to obtain the quality criterion Q in Equation 3.
Revised: In the paper, precision Pr j and recall Rc j are used to obtain the quality criterion Q in Equation 3.

Original: The calculations of Pr j and Rc j are illustrated by example in Figure 6.
Revised: The calculations of Pr j and Rc j are illustrated by example in Figure 6.

Original: Given a dataset that has 15 samples of three classes, assume that one probe sample belonging to class 1 is selected from the dataset.
Revised: Given a dataset that has 15 samples of three classes, assume that one probe sample belonging to class 1 is selected from the dataset.

Original: Samples are first ranked by their similarities to the probe.
Revised: Samples are first ranked by their similarities to the probe.

Original: For candidate neighbours of size j ( j = 6 ), Pr j and Rc j are 46 and 48 respectively, as calculated in the Figure 6.
Revised: For candidate neighbours of size j ( j = 6 ), Pr j and Rc j are 46 and 48 respectively, as calculated in the Figure 6.

Original: 𝑣 ! !
Revised: 𝑣 ! !

Original: 𝑣 ! "
Revised: 𝑣 ! "

Original: 𝑣 ! # 𝑣 ! $ select probe rank by the similarity 𝑣 !
Revised: 𝑣 ! # 𝑣 ! $ select probe rank by the similarity 𝑣 !

Original: % 𝑣 ! & 𝑃𝑟 ’ | ’() =
Revised: % 𝑣 ! & 𝑃𝑟 ’ | ’() =

Original: = 4𝑅𝑐 ’ | ’() = =
Revised: = 4𝑅𝑐 ’ | ’() = =

Original: 4candidate neighbours of size j =
Revised: 4candidate neighbours of size j =

Original: [Figure] [Figure]
Revised: [Figure] [Figure]

Original: [Figure]
Revised: [Figure]

Original: A. T HE J ACCARD SIMILARITY
Revised: A. T HE J ACCARD SIMILARITY

Original: In the paper, feature similarities are calculated in the structure space as in Equation 2.
Revised: In the paper, feature similarities are calculated in the structure space as in Equation 2.

Original: This similarity includes the Jaccard similarity which is calculated based on the k -reciprocal nearest neighbours (Zhong et al., 2017), defined as
Revised: This similarity includes the Jaccard similarity which is calculated based on the k -reciprocal nearest neighbours (Zhong et al., 2017), defined as

Original: [Equation]
Revised: [Equation]

Original: where R ∗ ( v , k ) encodes the structure information of feature v with a variant version of k -reciprocal nearest neighbours:
Revised: where R ∗ ( v , k ) encodes the structure information of feature v with a variant version of k -reciprocal nearest neighbours:

Original: [Equation]
Revised: [Equation]

Original: where
Revised: where

Original: [Equation]
Revised: [Equation]

Original: With the definition above, data distribution can be perceived in the structure space to obtain more accurate feature similarities.
Revised: With the definition above, data distribution can be perceived in the structure space to obtain more accurate feature similarities.

Original: A. D ESIGNS OF ADAPTIVE FILTER
Revised: A. D ESIGNS OF ADAPTIVE FILTER

Original: In the paper, four kinds of different designs for the adaptive filter are proposed and their performances are compared in Table 5.
Revised: In the paper, four kinds of different designs for the adaptive filter are proposed and their performances are compared in Table 5.

Original: Two methods estimate Q values, and two estimate k off directly.
Revised: Two methods estimate Q values, and two estimate k off directly.

Original: Table 6 shows detailed descriptions of the four designs.
Revised: Table 6 shows detailed descriptions of the four designs.

Original: [Table]
Revised: [Table]

Original: determined by Equation 4 using predicted Q -
Revised: determined by Equation 4 using predicted Q -

Original: [Table]
Revised: [Table]

Original: Use a quadratic curve to fit the trends of Q ( j ) with respect to j , which is then used to predict Q values to get ˆ k off as defined in Equation 4 during inference.
Revised: Use a quadratic curve to fit the trends of Q ( j ) with respect to j , which is then used to predict Q values to get ˆ k off as defined in Equation 4 during inference.

Original: The parameters of the quadratic curve is learned as targets in this method.
Revised: The parameters of the quadratic curve is learned as targets in this method.

Original: [Table]
Revised: [Table]

Original: Formulate the k off estimation as a multi-class classification task.
Revised: Formulate the k off estimation as a multi-class classification task.

Original: One class for each possible j value in Equation 4 and use softmax loss in training.
Revised: One class for each possible j value in Equation 4 and use softmax loss in training.

Original: [Table]
Revised: [Table]

Original: Regress directly the ground-truth k off values as defined in Equation 4.
Revised: Regress directly the ground-truth k off values as defined in Equation 4.

Original: A. C LUSTERING WITH FIXED THRESHOLDS
Revised: A. C LUSTERING WITH FIXED THRESHOLDS

Original: In addition to directly selecting the nearest k neighbours to build the graph as in Figure 5 (a), selecting nearest neighbours by a fixed similarity threshold is also evaluated.
Revised: In addition to directly selecting the nearest k neighbours to build the graph as in Figure 5 (a), selecting nearest neighbours by a fixed similarity threshold is also evaluated.

Original: In Table
Revised: In Table

Original: [Table]
Revised: [Table]

Original: it is observed that the best performance is achieved when the similarity threshold is 0 .
Revised: it is observed that the best performance is achieved when the similarity threshold is 0 .

Original: The highest Pairwise and
Revised: The highest Pairwise and

Original: BCubed F-score are 87.59 and 87.13, which are much lower than 92.79 and 91.40 of Ada-NETS.
Revised: BCubed F-score are 87.59 and 87.13, which are much lower than 92.79 and 91.40 of Ada-NETS.

Original: This shows that the method of selecting neighbours by a fixed threshold for all samples is not as good as the proposed method in Ada-NETS, which is adaptive for each sample.
Revised: This shows that the method of selecting neighbours by a fixed threshold for all samples is not as good as the proposed method in Ada-NETS, which is adaptive for each sample.

Original: [Table]
Revised: [Table]

Original: A. C LUSTERING WITHOUT GCN S
Revised: A. C LUSTERING WITHOUT GCN S

Original: When a graph with clean and rich edges is built after neighbour discovery, a naive graph-cut can be conducted on the graph as the clustering baseline.
Revised: When a graph with clean and rich edges is built after neighbour discovery, a naive graph-cut can be conducted on the graph as the clustering baseline.

Original: The graph-cut method directly breaks the edges that have similarities lower than a predefined similarity threshold (which is tuned for the best), and no GCNs are used.
Revised: The graph-cut method directly breaks the edges that have similarities lower than a predefined similarity threshold (which is tuned for the best), and no GCNs are used.

Original: [Table]
Revised: [Table]

Original: In Table 8, the first two lines show the clustering performance of graph-cut in the original space and structure space.
Revised: In Table 8, the first two lines show the clustering performance of graph-cut in the original space and structure space.

Original: Compared with Ada-NETS, the first two methods have very poor performances.
Revised: Compared with Ada-NETS, the first two methods have very poor performances.

Original: This shows that the GCN module is important for clustering.
Revised: This shows that the GCN module is important for clustering.

Original: In addition, it can be seen that the clustering performance using graph-cut in the structure space is better than in the original space, proving that vertices can obtain robust features by encoding more texture information after perceiving the data distribution in the structure space.
Revised: In addition, it can be seen that the clustering performance using graph-cut in the structure space is better than in the original space, proving that vertices can obtain robust features by encoding more texture information after perceiving the data distribution in the structure space.

Original: A. C LUSTERING TIME - CONSUMING ANALYSIS
Revised: A. C LUSTERING TIME - CONSUMING ANALYSIS

Original: Empirically, Ada-NETS takes about 18.9 minutes to cluster part 1 test set (about 584k samples) on 54 E5-2682 v4 CPUs and 8 NVIDIA P100 cards.
Revised: Empirically, Ada-NETS takes about 18.9 minutes to cluster part 1 test set (about 584k samples) on 54 E5-2682 v4 CPUs and 8 NVIDIA P100 cards.

Original: It is much faster than L-GCN (Wang et al., 2019b) and
Revised: It is much faster than L-GCN (Wang et al., 2019b) and

Original: LTC
Revised: LTC

Original: (Yang et al., 2019) which take 86.8 minutes and 62.2 minutes, but slower than
Revised: (Yang et al., 2019) which take 86.8 minutes and 62.2 minutes, but slower than

Original: STAR-FC (Shen et al., 2021), DA-NET (Guo et al., 2020) and VE-GCN (Yang et al., 2020) which take about 5 to 11 minutes.
Revised: STAR-FC (Shen et al., 2021), DA-NET (Guo et al., 2020) and VE-GCN (Yang et al., 2020) which take about 5 to 11 minutes.

Original: Many parts of Ada-NETS can be easily parallelized, but it is out of the scope of this work.
Revised: Many parts of Ada-NETS can be easily parallelized, but it is out of the scope of this work.

Original: Although Ada-NETS is not the fastest, the time consumption is still within a reasonable range.
Revised: Although Ada-NETS is not the fastest, the time consumption is still within a reasonable range.

Original: A. C OMPARISON WITH OTHER GRAPH BUILDING METHODS
Revised: A. C OMPARISON WITH OTHER GRAPH BUILDING METHODS

Original: In Figure 5 (a) , the Bcubed F-score of Ada-NETS is compared with four other graph building methods under different k value to show its superiority and robustness.
Revised: In Figure 5 (a) , the Bcubed F-score of Ada-NETS is compared with four other graph building methods under different k value to show its superiority and robustness.

Original: Methods for comparison include: k NN, Structure k NN, Threshold, and Chain Sim.
Revised: Methods for comparison include: k NN, Structure k NN, Threshold, and Chain Sim.

Original: Table 9 shows detailed description of these graph building methods.
Revised: Table 9 shows detailed description of these graph building methods.

Original: [Table]
Revised: [Table]

Original: k is set at 10, 20, 40, 80 and 160.
Revised: k is set at 10, 20, 40, 80 and 160.

Original: Each vertex is connected with its k nearest neighbours as in Yang et al.Structure
Revised: Each vertex is connected with its k nearest neighbours as in Yang et al.

Original: [Table]
Revised: [Table]

Original: k is set at 10, 20, 40, 80 and 160.
Revised: k is set at 10, 20, 40, 80 and 160.

Original: Each vertex is connected with its k nearest neighbours in the structure space proposed in the paper.
Revised: Each vertex is connected with its k nearest neighbours in the structure space proposed in the paper.

Original: Threshold
Revised: [Table]

Original: Vary the threshold from 0.55 to 0.75 by step of 0.05.
Revised: Vary the threshold from 0.55 to 0.75 by step of 0.05.

Original: k is calculated as the mean of the neighbours for each vertex at the given threshold.
Revised: k is calculated as the mean of the neighbours for each vertex at the given threshold.

Original: Choose neighbours whose cosine similarities to the probe vertex are smaller than a predefined threshold as in Guo et al.
Revised: Choose neighbours whose cosine similarities to the probe vertex are smaller than a predefined threshold as in Guo et al.

Original: [Table]
Revised: [Table]

Original: Vary the similarity threshold from 0.4 to 0.8 by step of 0.1.
Revised: Vary the similarity threshold from 0.4 to 0.8 by step of 0.1.

Original: k is calculated as the mean of the number of neighbours for each vertex at the given threshold.
Revised: k is calculated as the mean of the number of neighbours for each vertex at the given threshold.

Original: First calculate each vertex’s density, and then construct a chain by incrementally adding the vertices which have similarity scores higher than a predefined threshold and also densities larger than the last one as in Guo et al.
Revised: First calculate each vertex’s density, and then construct a chain by incrementally adding the vertices which have similarity scores higher than a predefined threshold and also densities larger than the last one as in Guo et al.

Original: Graph of Ada-NETS
Revised: Graph of Ada-NETS

Original: The candidate neighbour size is set at 10, 20, 40, 80 and 160.
Revised: The candidate neighbour size is set at 10, 20, 40, 80 and 160.

Original: Build the graph with the method proposed in Ada-NETS.
Revised: Build the graph with the method proposed in Ada-NETS.

Original: A. A DA -NETS WITH BETTER FEATURES EMBEDDINGS
Revised: A. A DA -NETS WITH BETTER FEATURES EMBEDDINGS

Original: The discriminating graph embeddings of “GE + AND + SS” are used as the input of Ada-NETS to get the final clustering results.
Revised: [Table] These discriminating graph embeddings of “GE + AND + SS” are used as the input of Ada-NETS to get the final clustering results for enhancement ( θ = 0 . 99 ).

Original: The performance is shown in Table 10.
Revised: In Table 10, the clustering results on

Revised: MS-Celeb-1M are compared with the ones using original feature embeddings.

Revised: It is observed that the

Original: [Table]
Revised: [Table]