DOI: 10.4231/hyvk-g966
title: Sensor-based indicators of performance changes between sessions during robotic surgery training

description: &lt;p&gt;Wu, C., Cha, J., Sulek, J., Zhou, T., Sundaram, C. P., Wachs, J., Proctor, R., &amp; Yu, D. (in press). Sensor-based indicators of performance changes between sessions during robotic surgery training. Applied Ergonomics. https://doi.org/10.​1016/​j.​apergo.​2020.​103251 &lt;/p&gt;

&lt;p&gt; &lt;/p&gt;

&lt;p&gt;Train&shy;ing of sur&shy;geons is es&shy;sen&shy;tial for safe and ef&shy;fec&shy;tive us&shy;age of ro&shy;botic surgery, yet cur&shy;rent as&shy;sess&shy;ment tools for learn&shy;ing pro&shy;gres&shy;sion are lim&shy;ited. The ob&shy;jec&shy;tive of this study was to mea&shy;sure changes in trainees&rsquo; cog&shy;ni&shy;tive and be&shy;hav&shy;ioral states as they pro&shy;gressed in a ro&shy;botic sur&shy;geon train&shy;ing cur&shy;ricu&shy;lum at a med&shy;ical in&shy;sti&shy;tu&shy;tion. Seven sur&shy;gi&shy;cal trainees in urol&shy;ogy who had no for&shy;mal ro&shy;botic train&shy;ing ex&shy;pe&shy;ri&shy;ence par&shy;tic&shy;i&shy;pated in the sim&shy;u&shy;la&shy;tion cur&shy;ricu&shy;lum. They per&shy;formed 12 ro&shy;botic skills ex&shy;er&shy;cises with vary&shy;ing lev&shy;els of dif&shy;fi&shy;culty repet&shy;i&shy;tively in sep&shy;a&shy;rate ses&shy;sions. EEG (elec&shy;troen&shy;cephalo&shy;gram) ac&shy;tiv&shy;ity and eye move&shy;ments were mea&shy;sured through&shy;out to cal&shy;cu&shy;late three met&shy;rics: en&shy;gage&shy;ment in&shy;dex (in&shy;di&shy;ca&shy;tor of task en&shy;gage&shy;ment), pupil di&shy;am&shy;e&shy;ter (in&shy;di&shy;ca&shy;tor of men&shy;tal work&shy;load) and gaze en&shy;tropy (in&shy;di&shy;ca&shy;tor of ran&shy;dom&shy;ness in gaze pat&shy;tern). Per&shy;for&shy;mance scores (com&shy;ple&shy;tion of task goals) and men&shy;tal work&shy;load rat&shy;ings (NASA-Task Load In&shy;dex) were col&shy;lected af&shy;ter each ex&shy;er&shy;cise. Changes in per&shy;for&shy;mance scores be&shy;tween train&shy;ing ses&shy;sions were cal&shy;cu&shy;lated. Analy&shy;sis of vari&shy;ance, re&shy;peated mea&shy;sures cor&shy;re&shy;la&shy;tion, and ma&shy;chine learn&shy;ing clas&shy;si&shy;fi&shy;ca&shy;tion were used to di&shy;ag&shy;nose how cog&shy;ni&shy;tive and be&shy;hav&shy;ioral states as&shy;so&shy;ci&shy;ate with per&shy;for&shy;mance in&shy;creases or de&shy;creases be&shy;tween ses&shy;sions. The changes in per&shy;for&shy;mance were cor&shy;re&shy;lated with changes in en&shy;gage&shy;ment in&shy;dex (&lt;img data-original-height="13.330357551574707" data-original-width="105.30357360839844" src="https://pcv3-elsevier-live.s3.amazonaws.com/proofs/elsevier/JERG/103251/images/image_proof/si1.svg" /&gt;) and gaze en&shy;tropy (&lt;img data-original-height="13.330357551574707" data-original-width="109.30357360839844" src="https://pcv3-elsevier-live.s3.amazonaws.com/proofs/elsevier/JERG/103251/images/image_proof/si2.svg" /&gt;). Changes in cog&shy;ni&shy;tive and be&shy;hav&shy;ioral states were able to pre&shy;dict train&shy;ing out&shy;comes with 72.5% ac&shy;cu&shy;racy. Find&shy;ings sug&shy;gest that cog&shy;ni&shy;tive and be&shy;hav&shy;ioral met&shy;rics cor&shy;re&shy;late with changes in per&shy;for&shy;mance be&shy;tween ses&shy;sions. These mea&shy;sures can com&shy;ple&shy;ment cur&shy;rent feed&shy;back tools used by med&shy;ical ed&shy;u&shy;ca&shy;tors and learn&shy;ers for skills as&shy;sess&shy;ment in ro&shy;botic surgery train&shy;ing.&lt;/p&gt;
description: Ro­botic surgery
Eye track­ing
Elec­troen­cephalo­gram
Sim­u­lated train­ing
Per­for­mance