Patent CA-3123913-A1 (CA)
Title: System and method for virtual online assessment of medical training and competency
Inventor: QAYUMI ABDUL KARIM
IPC: G06N20/00
Filed: 2021-07-05
Abstract: There is disclosed a system and method for providing an assessment of medical competencies. In an embodiment, the method comprises: providing a virtual interactive environment for access by an expert and by a student; providing an artificial intelligence machine learning engine for generating random scenarios and interactions for testing competencies; and based on the student's response to the random scenarios and interactions, performing a machine assessment of the student's competency. In another embodiment, the method further comprises providing an expert assessment by the expert of the student's competency. In another embodiment, the method further comprises combining the machine assessment and the expert assessment to calculate an overall score.     Architectural Design of Competency Based Assessment System e _______________ CCMIpeten(y.Based As,,c,,k,nictele;   Ph-atm-ill _____________________________ /N. _____________ Online Virtual                                               Online Virtual Documentation                                               Interactive Patient õ _______________________________________________________________________ 'V                                             V  1, r,entbti-:,, EAT%              4,........    (.011111111/Th Or14.11 PII,    -ia1( al pi a, 114 4, i.,,aLl,,,, and 7,z I, , , .gies              Tools anl T,,, 1)(1,.],,Wr',         1 Tools and TechnologiF,5 Iv                                             If        118 114                      Evert Assessment j    Self Assessment    116    ( Machine Assessme:).4111-_______________ ii,                   .                        .  Dim t tA,,,a4:=rtierit by                    CainVOr irl:r', t'..i. Gold I                                                                      Scoring and Feedback standards 120-4.4..............................,%%1,    1                          126 Cve,aE 5::or-It C I lifrrf++,"*.! larnin*T) allin 130 132                                    Al                       FIG. 1 Date Recue/Date Received 2021-07-05 H istory Taking 204                           Competencies                                 206 luois Virtual Patient + Interactive Virtual Chart                                 Interactive Interviewing Technologies, Tools Deciamen-,at Ion              Firubillt,gs          nr-nmonir.-¶1,11 I(rhrp-    yag innim mom                                         , Ell th P hArt                                     1,y -1,,or,              by (=dreg 11110** .4111111111 216 E:=1                                     220 =II 222 A..             byr        Cog.14,4õ 11)1j I c.6 4.44Did    Scoring and Feedback I               xperts        standards chwa saw,                                          230 C=11110 F I G . 2 Date Recue/Date Received 2021-07-05 r ________________________________________________ "1 Physical Examination 304                              Competencies \\ /                                                     306 atansawat loots lackealogies    *Iii \ ________________________________________________ /      Interactive                                Virtual Patient + , Electronic Chart                                         Interactive Examination Tools 308                                     310        312                 \ 314 ____________ ; ______ {), r .1,1     n at Finclir,,, 4,.....             Commumcat1011 !,pec al [Yai-mnauon    6eneral E. ,m1mitiout In WWI 11.00000 00                                              0000* WW1 1 a the Chcot                    Techliiihodk,,, T Will    let:Imola .1,-, Technul )4p-s Tods le---******'.- ____ .4C __ 3"..... P*-11", `,.r.11",,,,`,,t"--,,:rlf,nr    1:1,), r--    A --,e, I-; --, +nen&   I=      At........,QE1 by    Convorinu to riom 1 - 2 E,perts standards , , Overall score                                      1 330 ' we. ko Alexi. 4..otiript- t,-Aricy FIG. 3 Date Recue/Date Received 2021-07-05 le _____________________________________________ Nik fnvestigation ____________________ Lo"./     Competencies N ______________________________________________________________________ 406 Virtual Labs + Imaging Interactive and Other Investigative Electronic Chart Data base 408                               410           412ft \ 414 Communkate                                 .0    ...'                Select Investigietk,i ,    Pla :. 1 . , Ogaden iN) the (tiort 0 _____________________________ 4 6                           'S 1           f                 -lf            420 -nt                           e .,,,,,:,.:1-/lent          Machine f.,.     :meot    422 It 426                                                               428 AILL-a¨..Le d by                                         121=1 C 114:17rd:G Id 1,pPrtt = cznin , FIG. 4 Date Recue/Date Received 2021-07-05 rillIMMIIIMMIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIMIN Management Nan 504                                           Competencies                506 Assammeat I qe.4.1eµlaiseasyjes ______________________________________________ I Virtual Patient + ,    Interactive Virtual Chart                       Compensative Database for Clinical Encounters if              1\ii    514 ., , sect Communicate               õõõ. õõ¨õ    .... ......    Plan Ibianimement Ntwkit,enl,nt In the Chtrt                                Orr.. _______________________________________________________________________________ __ . ___________ /11110 1 . Alit  ___________________________________________ AL"'"eil 516                      Expert Assessment=           SW r\ssessment    520 Machint A _, :..essr7erit    522 ___________ 4%....,.........õ...:;:..d.aõr,dks.     _______________________  L  __ Overall 'm-or-f    I    530 Mieve to Nem Competency . FIG. 5 Date Recue/Date Received 2021-07-05 t.        't Patient Transfer Competencies ________________________________________________ i Virtual Patient + Interactive Virtual Tools for Electronic Chart Handover __________ L  _____________________ 610          612 if                                                                    \ 614 1, JCILINITI, - , - i i t o 1 li ,11,143, tr COMMUnkate                                 ..... ....... ....... .      Receiving    ¨ 1    Sending    1 i rt the C ha rt V                                                       .NI***sN.NA 616    Expert Assessment     Seit Assessment    ) 620     Machine Assessment 624         'IV          s       V             626             /           628 .,, (Zonamparbkg to Go kl    Scoring and Feedback Ar,,sed 4, 1 = I i:q),ic-1 standards \ OveraN Score I( Move to Next Cortspetency ) FIG. 6 Date Recue/Date Received 2021-07-05 Ancillary Care Competencies Ss% ___________________________________________ Virtual Patient + Interactive Compensative Database Electronic Chart for Clinical Encounters DocuinenIdtion of                                 'Aar: t DeCis.011 P,1,:471-13 Communkato                                      A               OXIA      .',71-rstgt=tia,,nt                      the Chzir    .7)ption P lin 716     Expert Ast.el,synent    I            Self Asst,!,snteilt        720 Machr    i    722 COO WARS Di 4 WI Scoring and Feedback 1 -I                    standards = Overelf Score Move to Neat Competency FIG. 7 Date Recue/Date Received 2021-07-05 if                                                 \ Competencies for Delivering 804                             Difficult News                            806 Amok Itl, jit i 4 f 11i N i th.11 MA OfieS 44141,. __________________________________________ I Virtual Environment + Interactive Tools & Technologies for Electronic Chart Delivering Difficult News V"                        808                                   w L                                                                              Communic aim DeSerins Difkull Neck,in the, ( hart 1111111:111 "'IIIIIIIIIIOIIIIIIIIIIIIIPIIIIIIIIPPIIIIPIIPIPPI--Self Assessment lir by                         Comm* to I -2 Expeen standards ________________________ ...              818 , oet,,II Scare                                        820 _________________________________________________ Move tn Pim, z C 0 ill J  prong,    ) FIG. 8 Date Recue/Date Received 2021-07-05 e                                                 s% Quality Improvement 904        /Competencies    906 Amessasent Tools Technologies    SISS \     4%.    i Virtual Environment + Interactive ,                                                           Qualitative Improvement    , Electronic Chart Tools Technologies /  908                                 910            912                   \\44 V                                                         i I _____________________________________ i Do.rlirnentanon and ( oarliinini,..itita                                   id,,ittifi,,ition il MI= 11111111 MEW WPM OIN                                           P MOO          Lnlitnoaa CC rrection TO 11111)1'0/19 %Imo kr7                            &                     m1 S,,:rti14" [  rrors Y                                                        -    -r,,,,,,,l En or, t i ,e n r Saty .40..   1      Expert Assessment                Sell Assessment    918 14, V        V  I, 1          ' !, po-rt3 standards                                     922 "%"**44%44444446.4v444":.\k _ ___________________ oy,r r II `- -,i4vo=      -    - ' --- - -    924 , tov, ,,.õ, Ne..t Lompeteney FIG. 9 Date Recue/Date Received 2021-07-05 Preventative Competencies 111A01,q003 1%. _____________________________________________ Interactive                                                  Virtual Environment + Electronic Chart                                          Preventative Measures Database "of 1008                            1010           1012 Dorumentariori in ¨                             Communication    ."""    Pe sc nal Advisee &fel The iharT   Exp en Ast; 5ament            Self Assess nt      1 018    ( Machine Asseasmem d romparbe to Gold                                             Scoring arld F  eedback 1 - 2 Ex p t'rts standards S = "m=   tami.to Next Com petency FIG. 10 Date Recue/Date Received 2021-07-05