feasibility and utility of artificial intelligence (ai) / machine learning (ml) - driven advanced intraoperative visualization and identification of critical anatomic structures and procedural phases in laparoscopic cholecystectomy

Conditions: Cholecystitis; Cholelithiasis; Biliary Dyskinesia

Summary: the goal of this study is to evaluate the utility and efficacy of an artificial intelligence (ai) model at identifying structures and phases of surgery compared to traditional white light assessment by trained surgeons. surgeons will perform the procedure in their standard practice, while the ai model analyzes data from the laparoscopic camera. surgeons will be asked to audibly state when they identify structures and enter different phases of the surgical procedure. the ai will not alter the surgeon's view or be visible to the surgeon, and the surgeon will perform the procedure in the exact same fashion as they typically do.

bile duct injury (bdi) during cholecystectomy is a serious surgical complication with increased risk of early death, serious ongoing morbidities including multiple reinterventions requiring prolonged and repeated hospital stay, and over a billion dollars in additional healthcare costs in us each year. the introduction laparoscopic approach has progressively increased overall laparoscopic cholecystectomy procedure volume, for clearly proven benefits of minimally invasive approach. however, despite the benefits, minimally invasive approach has resulted in increased and persistent incidence of bdi up to 4-folds in some reports. most major biliary injuries result from unrecognized or unintended perception, either misidentification or misinterpretation of the common bile or hepatic duct as the cystic duct or misidentification of an aberrant bile duct. it is increasingly clear that the routine use of intraoperative cholangiography (ioc) has a significant association with decreased and earlier intraoperative detection of bdi. the recent 'state of the art consensus conference on prevention of bile duct injury during cholecystectomy' in 2018 strongly recommended that documenting the critical view of safety (cvos) and a liberal use of ioc in anticipated difficult cholecystectomy are highly recommended steps that can potentially mitigate the risk of bdi during laparoscopic cholecystectomy (lc) in patients especially with uncertain anatomy or difficult dissection. performing traditional ioc laparoscopically under fluoroscopic guidance however can challenge surgeons' skills, is time-consuming, and requires a learning curve to interpret images. despite well-known and accepted risk factors for difficult cholecystectomies and potential for bdi, the use of advanced imaging for ioc however remains variable and highly user dependent. the rationale for selective use of ioc is attributable to the fact that the prevalence and incidence of bdi are low that an individual practitioner would infrequently encounter such complication in their daily practice or lifetime of a surgeon to justify a routine use. this is further compounded by the fact that radiation-based fluoroscopic ioc are cumbersome to efficient workflow, utility and cost (need for contrast reagent preparation and injection, potential adverse allergic reactions, risk of radiation exposure, training requirement, need for large capital equipment, space and cost), and variability in proficient analysis. recent randomized controlled trials using near-infrared fluorescent cholangiography (nifc) using indocyanine green (icg) demonstrated significantly superior visualization of extrahepatic biliary structures during laparoscopic cholecystectomy to white light (wli) alone. pre-dissection surgeon detection rates on naked eye were significantly higher (\> 1.8 - 3.1 folds) with nifc use for all 7 biliary structures than traditional wli alone. however, although similar intergroup differences were observed for all structures, addition of nifc did not improve additional detection of cystic duct and cystic duct/gallbladder junction after dissection has been done. in addition, increased body mass index was associated with reduced detection of most structures in both groups, especially before dissection. interestingly, only 2 patients, both in the wli group, sustained a biliary duct injury. activsighttm is an fda-cleared device that combines icg fluorescence for extrahepatic biliary visualization and laser speckle contrast imaging (lsci) for perfusion detection in a laparoscopic form factor. activsighttm allows augmented visualization to any current wli laparoscopic visualization system displaying both extrahepatic biliary icg and microperfusion over cystic duct and artery. as a non-significant risk device, activsighttm has been used in well over 150 patients for laparoscopic cholecystectomies and bariatric, esophageal, and colorectal procedures, with proven safety and utility. moreover, activsighttm allows raw infrared visualization data for advanced analysis and ai/ml model development. surgeons/scientists now have segmented and analyzed different procedural phases of lc, and developed inferencing models and algorithms using artificial intelligence (ai)/machine learning (ml) based on standard wli procedural videos. although ai/ml models recognizing different phases of lc procedures can be as accurate as 80-95% on limited trained dataset once structures have been clearly dissected, more relevant and key value would be in identifying critical structures such as bile ducts and arteries before and during, not after surgical dissection has been performed. early detection and identification of these critical structures before and during dissection of the triangle based on ai/ml trained on computer vision may aid surgeons in performing more effective and safer lc. activsighttm is an fda 510(k)-cleared optical imaging system based on monochromatic coherent light known as laser-speckle-contrast imaging (lsci) and represents a label-free imaging method using coherent monochromatic light where blood flow and tissue perfusion can be detected. a small imaging module that fits between any existing laparoscope and camera systems and a separate light source placed along any current commercial system will deliver objective real-time tissue perfusion and blood flow information intraoperatively. in addition, activsighttm can also effectively display with push of button an icg-based visualization of the biliary tree in real time at equivalent or superior to current commercial products. the innovative form factor of activsight enables any laparoscopic system for icg-based visualization at a fraction of the cost of current competitor with minimal disruption to workflow. activinsighttm is a prototype software feature in activsighttm that recognizes procedural phases and critical anatomic structures, namely gallbladder, cystic duct, and cystic artery during lc using ai/ml-based algorithms. the key difference of activinsighttm to other models reported in the literature is that activinsighttm is trained on dataset annotated using icg and lsci in addition to wli. in this trial, the investigators propose to first validate and then test the precision and accuracy of activinsighttm in detecting critical phases and structures and compare the performance of the algorithms to those based on models developed using wli only and traditional surgeon's naked eye detection during lc in pre-and mid-dissection phases. to eliminate any bias, the investigators will connect a secondary screen blinded to the main operating surgeon screens so that real-time function of the ai/ml is not visible to operating surgeons, to perform real-time analysis and comparison of routine use of advanced augmented visualization versus current wli visualization alone with or without computer vision-based ai/ml.

Eligibility criteria:
inclusion criteria * all patients age \> 18 years old who are planned for elective laparoscopic cholecystectomy; spoken command and literacy in the native language spoken at each participating center; ability to understand and follow study procedures; and having provided signed consent. * eligible patients will be screened and assigned as per risk calculator for difficulty of lc * diagnosis: * all patients with clinical suspicion and diagnosis of symptomatic cholelithiasis or cholecystitis planned for cholecystectomy. * typical imaging as per standard workup findings including us, ct and/or mri. plain radiographs and contrast imaging may be obtained by referring physicians and are helpful for confirming the clinical diagnosis. * prior therapy: o patients with prior surgery are eligible for enrollment. * laboratory: * hemoglobin \> 9 g/dl * platelet count ≥75,000/µl (may receive transfusions) * normal prothrombin time (pt), partial thromboplastin time (ptt) and international normalized ratio (inr) \< 1.5 x upper limit of normal (including patients on prophylactic anticoagulation) * liver function test * renal function: age-adjusted normal serum creatinine * adequate pulmonary function: defined as no dyspnea at rest, and a pulse oximetry \>94% on room air if there is any clinical indication for determination. exclusion criteria * non-elective acute cholecystectomy will be excluded. * patients assigned to fda cleared icg-based visualization are contraindicated for any chronic renal dysfunction, potential drug interaction, history of allergy to icg or anaphylaxis, and pregnancy. * patients eligible for cholecystectomy, exclusion criteria include known allergy to icg; coagulopathy or known, pre-existing liver disease; pregnancy or breast-feeding; or being of reproductive age with pregnancy possible and not ruled out. * patients currently in any investigational agents. * adults unable to consent * individuals under 18 years of age * pregnant women * prisoners * vulnerable populations

Keywords: artificial intelligence laparoscopy laparoscopic surgery