Identifying and matching 12‐level multistained glomeruli via deep learning for diagnosis of glomerular diseases

Authors:
raw_author_name: Qiming He
raw_affiliation_string: Institute of Biopharmaceutical and Health Engineering Tsinghua Shenzhen International Graduate School Shenzhen China
raw_author_name: Siqi Zeng
raw_affiliation_string: Institute of Biopharmaceutical and Health Engineering Tsinghua Shenzhen International Graduate School Shenzhen China; Research Institute of Tsinghua Pearl River Delta Guangzhou China
raw_author_name: Shuang Ge
raw_affiliation_string: Institute of Biopharmaceutical and Health Engineering Tsinghua Shenzhen International Graduate School Shenzhen China
raw_author_name: Yanxia Wang
raw_affiliation_string: Department of Pathology, State Key Laboratory of Cancer Biology, Xijing Hospital Fourth Military Medical University, China School of Basic Medicine, Fourth Military Medical University Xi'an China
raw_author_name: Jing Ye
raw_affiliation_string: Department of Pathology, State Key Laboratory of Cancer Biology, Xijing Hospital Fourth Military Medical University, China School of Basic Medicine, Fourth Military Medical University Xi'an China
raw_author_name: Yonghong He
raw_affiliation_string: Institute of Biopharmaceutical and Health Engineering Tsinghua Shenzhen International Graduate School Shenzhen China
raw_author_name: Tian Guan
raw_affiliation_string: Institute of Biopharmaceutical and Health Engineering Tsinghua Shenzhen International Graduate School Shenzhen China
raw_author_name: Zhe Wang
raw_affiliation_string: Department of Pathology, State Key Laboratory of Cancer Biology, Xijing Hospital Fourth Military Medical University, China School of Basic Medicine, Fourth Military Medical University Xi'an China
raw_author_name: Jing Li
raw_affiliation_string: Department of Pathology, State Key Laboratory of Cancer Biology, Xijing Hospital Fourth Military Medical University, China School of Basic Medicine, Fourth Military Medical University Xi'an China

Abstract: Abstract The assessment of glomerular lesions is a fundamental step toward the diagnosis of glomerular diseases. This requires diagnosis and fusion of information from all the glomeruli at multiple levels and stainings. The lack of research on multi‐level multistained glomerular identification and matching has resulted in renal pathologists devoting much time and attention to this time‐consuming and labor‐intensive process. This limits the overall efficiency of the diagnosis of glomerular diseases. This paper constructed a dataset consisting of 600 cases, each containing 12 levels of whole slide images from H&amp;E, PAS, Masson trichrome, and PASM staining. The glomeruli identifying and matching was proposed. First, a multistained transformer‐based Mask R‐CNN is proposed to extract the position and contours of the glomeruli. Second, coherent point drift‐based coarse matching and hybrid feature‐based fine matching achieve pairwise matching. Finally, the voting‐based cross‐matching realizes 12‐level multistained matching. This system constitutes a practical human‐computer interface. Intensive experiments were conducted to validate the ability to identify and match 12‐level multistained glomeruli. The mAP@50 for detection and segmentation reached 95.40% and 95.70%, respectively. The basic and comprehensive matching rates of the glomeruli matching reached 98.25% and 74.59%, respectively. Visualization results further demonstrate that the model achieved accurate identification and matching. The proposed system achieves accurate identification and matching of 12 levels of multistained glomeruli and can serve as a tool for pathological diagnosis of glomerular diseases by simplifying the diagnostic process. More importantly, this system can lay the foundation for the fully automated assisted diagnosis of glomerular diseases.