Moscow experiment on computer vision in radiology: involvement and participation of radiologists
Authors:   Research and Practical Clinical Center of Diagnostics and Telemedicine Technologies, Department of Health Care of Moscow, Morozov S. P. , Vladzymyrskyy A. V. ,   Research and Practical Clinical Center of Diagnostics and Telemedicine Technologies, Department of Health Care of Moscow, Ledikhova N. V. ,   Research and Practical Clinical Center of Diagnostics and Telemedicine Technologies, Department of Health Care of Moscow, Andrejchenko A. E. ,   Research and Practical Clinical Center of Diagnostics and Telemedicine Technologies, Department of Health Care of Moscow, Arzamasov K. M. ,   Research and Practical Clinical Center of Diagnostics and Telemedicine Technologies, Department of Health Care of Moscow, Balanjuk E. A. ,   Municipal Clinical Hospital № 40, Department of Health Care of Moscow, Gombolevskij V. A. ,   Research and Practical Clinical Center of Diagnostics and Telemedicine Technologies, Department of Health Care of Moscow, Ermolaev S. O. ,   Research and Practical Clinical Center of Diagnostics and Telemedicine Technologies, Department of Health Care of Moscow, Zhivodenko V. S. ,   Municipal Polyclinic № 218, Department of Health Care of Moscow, Idrisov I. M. ,   Municipal Polyclinic № 12, Department of Health Care of Moscow, Kirpichev Ju. S. ,   Research and Practical Clinical Center of Diagnostics and Telemedicine Technologies, Department of Health Care of Moscow, Logunova T. A. ,   Research and Practical Clinical Center of Diagnostics and Telemedicine Technologies, Department of Health Care of Moscow, Nuzhdina V. A. ,   Municipal Polyclinic № 115, Department of Health Care of Moscow, Omeljanskaja O. V. ,   Research and Practical Clinical Center of Diagnostics and Telemedicine Technologies, Department of Health Care of Moscow, Rakovchen V. G. ,   Municipal Polyclinic № 8, Department of Health Care of Moscow, Slepushkina A. V. ,   Municipal Polyclinic № 3, Department of Health Care of Moscow
Published: December 2020

B a c k g r o u n d . In 2019, the Moscow Government decided to conduct a large-scale scientific research – an the Experiment on the use of innovative computer vision technologies for medical image analysis and subsequent applicability in the healthcare system of Moscow (www.mosmed.ai). O b j e c t i v e – analyze engagement, attitudes and feedback from doctors-radiologists in frame of the Experiment. M a t e r i a l s a n d m e t h o d s . The Experiment is a prospective research approved by the Independent Ethics Committee and registered with Clinicaltrails.gov (ID NCT04489992). Patients signed informed voluntary consent. On the date 01.10.2020, ten services are involved in the Experiment, they providing automated analysis of chest computed tomography and x-ray, mammography. The study includes quantitative indicators of the Experiment from 06/18/2020 to 10/01/2020. Methods of social survey, descriptive statistics, assessment of diagnostic accuracy metrics were used. R e s u l t s a n d d i s c u s s i o n . During the first four months of the active phase of the Experiment, ten computer vision services were integrate into Unified Radiology Service of Moscow. More then 497 thousand studies have been successfully analyzed. Analyzes is carried out for 884 diagnostic devices in 293 medical organizations, 272 of them are actively involved. The involvement of medical organizations is 82%. The median time for automatic analysis of 1 study is 8 minutes. Overall, 63% of studies were analyzed in less than 15 minutes. At the beginning of the Experiment, 538 doctors had access to the system; in four months this number increased to 899. The involvement of doctors was 24%, which is slightly higher than the global indicators. According to the results of a sociological survey, the attitude to AI technologies of Moscow radiologists can be characterize as expectant, moderately optimistic. Radiologists have determined that the results of computer vision services are fully consistent with the real situation in 64% of cases. In 36% cases some inconsistencies were recorded; of this number, significant discrepancies took place in 6%, insignificant – in 23%. C o n c l u s i o n . Results of the Experiment’s first four months can be consider as successful. A high level of involvement of radiologists is define. Special measures will be implement to increase the involvement of radiologists, as well as a comprehensive comparative assessment of the work of services at the further stages of the Experiment.