Abstract. We present an instance segmentation scheme based on pixel affinity information, which is the relationship of two pixels belonging to a same instance. In our scheme, we use two neural networks with similar structure. One is to predict pixel level semantic score and the other is designed to derive pixel affinities. Regarding pixels as the vertexes and affinities as edges, we then propose a simple yet effective graph merge algorithm to cluster pixels into instances. Experimental results show that our scheme can generate fine grained instance mask. With Cityscapes training data, the proposed scheme achieves 27.3 AP on test set.
In post-processing step, Liu et al. REF present a pixel affinity scheme and cluster pixels into instances with a simple yet effective graph merge algorithm.
Affinity Derivation and Graph Merge for Instance Segmentation
ArXiv
ArXiv
Computer Science