Table 13: Overview of our collected medical dataset
No	Data Name	Topic	Disease	Modality	Dimension	Train/Test Rate?	Total
1	HyperKvasir [97]	Polyp	Pathological classification	Color images	2D	Yes	110079
2	PatchCamelyon [98, 99]	Cells	Histopathologic scans of lymph node sections.	Color images	2D	Yes	327680
3	BraTS2018 [100, 101, 64]	Brain	Tumor Segmentation	MRI	3D	No	760
4	HNSCC [102]	Head Neck	No Label	CT	3D	No	155
5	LiTS2017 [103]	Liver	Segmentation of Liver and Tumor Lesions	CT	3D	No	200
6	MSD-Heart [96]	Heart	Heart Segmentation	MRI	3D	No	30
7	MSD-Liver [96]	Liver	Liver Segmentation	MRI	3D	No	201
8	MSD-Lung [96]	Lung	Lung Segmentation	MRI	3D	No	96
9	MSD-Pancreas [96]	Pancreas	Pancrea Segmentation	MRI	3D	No	420
10	MSD-HepaticVessel [96]	Hepatic Ves- sel	Hepatic Vessel Seg-mentation	MRI	3D	No	443
11	MSD-Spleen [96]	Spleen	Spleen Segmentation	MRI	3D	No	61
12	MSD-Colon [96]	Colon	Colon Segmentation	MRI	3D	No	190
13	OPC-Radiomics [104–106]	Oropharynx	No Label	CT	3D	No	120
14	Osteosarcoma- UT [107, 108, 105]	Osteosarcoma	No Label	Color images	2D	No	547
15	Pancreas-CT [109, 110, 105]	Pancreas	No Label	CT	3D	No	16
No	Data Name	Topic	Disease	Modality	Format	Default Train/Test Rate	Total
16	Pelvic- Reference- Data [108, 105]	Pelvic	No Label	CT	3D	No	12
17	ProstateX [111, 112, 105]	Prostate	The clinical signifi-cance of prostate le-sions prediction	MRI	3D	No	40
18	TCGA-CESC [113, 105]	Cervical	No Label	Color images	2D	No	3977
19	TCGA- COAD [114, 105]	Colon	No Label	Color images	2D	No	1644
20	TCGA-ESCA [115, 105]	Cuticle	No Label	Color images	2D	No	4427
21	TCGA-KICH [116, 105]	Kidney	No Label	Color images	2D	No	2192
22	TCGA-KIRC [117, 105]	Kidney	No Label	Color images	2D	No	34108
23	TCGA- READ [114, 105]	Rectum	No Label	Color images	2D	No	248
24	TCGA-SARC [118, 105]	Sarcoma	No Label	Color images	2D	No	624
25	TCGA- THCA [114, 105]	Thyroid	No Label	Color images	2D	No	665
26	VinDr [73]	Lung	Abnormal Disease Classification	X-ray	2D	No	18000
27	LUNA2016 [94]	Lung	Nodule Detection and False Positive Reduc-tion	CT	3D	No	49386
28	BCCD [119]	Cells	Blood cell detection	Color images	2D	No	364
29	C- NMC_Leukemia [120, 121]	Cells	Leukemia detection	Color images	2D	Yes	12529
30	CBIS-DDSM [122, 123]	Breast	Breast Cancer Classi-fication	X-ray	2D	No	6774
31	COVIDx [124]	Lung	Covid-19 Detection	X-ray	2D	Yes	194922
32	Heidelberg OCT [125]	Eye	OCT Imaging Classi-fication	OCT	2D	Yes	84495
33	m2caiSeg [126]	Laparoscopic	Semantic Segmente-tion Laparoscopic	Color images	2D	Yes	614
34	NuCLS [127]	Nucleus	Nucleus Segmen-tation Detection / Classification	Color images	2D	Yes	1744
35	SARAS- MESAD [128][129][130]	Prostatectomy Procedures	Action classification in Prostatectomy Surgey	Color images	2D	Yes	29454
36	Shoulder X-ray images from Sun Yat-sen Memorial Hospital [131]	Shoulder	Shoulder X-ray Classi-sification	X-ray	2D	Yes	1049
37	Shenzhen Hospital X-ray Set [132]	Lung	Lung segmentation	X-ray	2D	No	566
38	ADNI 1.5T [133, 134]	Brain	Alzheimer's Disease Classification	MRI	3D	No	639
39	ADNI 3T [133, 134]	Brain	Alzheimer's Disease Classification	MRI	3D	No	119
40	AML-Cytomorphology [135, 136, 105]	Cell	Peripheral blood smears	Color images	2D	No	18365
41	APTOS 2019 [137]	Eye	Severity of diabetic retinopathy Classification	Color images	2D	No	3662
42	BCSS [138]	Cells	Breast cancer semantic segmentation	Color images	2D	No	151
43	Dental Panoramic [139]	Tooth	Mandible segmentation	X-ray	2D	No	116
44	HC18 [140]	Fetal	Fetal head circumfer-ence (HC)	Ultrasound	2D	No	999
45	Hippseg 2011 [141]	Brain	Hippocampus Segmentation	MRI	3D	No	3050
46	ISIC Chalenge 2019 [142]	Skin	Skin Cancer Classification	Color images	2D	No	25331
47	KiTS19-21 [143]	Kidney	Kidney Segmentation	CT	3D	No	45424
48	Kvasir v2 [144]	Gastrointestinal	Gastrointestinal can-cer image classification	Color images	2D	No	6000
49	LHNCBC Malaria [145]	Cells	Malaria Classification	Color images	2D	No	27560
50	MitoEM [146]	Cells	Mitochondria In-stance Segmentation	MRI/CT	3D	No	1000
51	MLL Bone Marrow [147]	Cells	Blood cell classification	Color images	2D	No	171374
52	MMWHS-CT[65]	Heart	Sub-structure Heart segmentation	CT	3D	Yes	40
53	MMWHS-MRI [65]	Heart	Sub-structure Heart segmentation	MRI	3D	Yes	40
54	RSNA Bone Age [148]	Bone	Bone age prediction	X-ray	2D	No	12611
55	EyePACS [149]	Eye	Diabetic Retinopathy Detection	Color Images	2D	Yes	88702