2_use_case_name: Nursing Proficiency Coach & Nurse Proficiency Evaluator...and beyond!
3_agency: Department of Veterans Affairs
3_abr: VA
4_bureau: VHA: Veterans Health Administration
8_topic_area: Education & Workforce
10_commercial_ai: None of the above.
11_purpose_benefits: Two custom GPTs have been created: Nurse Proficiency Writer and Nursing Proficiency Coach.  A GS version is in development.  The Nurse GPTs are used to compare the nurse's self-input against 600+ functional statements and standards (externally accessible or approved by the Office of Nursing Service).  It evaluates the nurse's performance against the standards, reports on positive findings, identifies weak areas, provides an estimated rating, and grade assessment.  The interactive GPT allows nurses to have a dialog to better understand how their practice can be improved.   Many of our 90,000+ RNs are not proficient in understanding the standards nor adept in writing performance reports. This leads to end-user frustration, quality issues with content, submission gaps compared to the standard, interrater reliability variances, and a host of other challenges with the our current process. The tool aids the nurses in developing the content for their ePerformance submission.  No PHI is allowed in nursing proficiencies (by standard), and PHII is scrubbed prior to submission by the nurse. 
12_outputs: 
The output takes the nurse's input and returns a summary of each practice dimension and positive accomplishments offering suggestions where the nurse can improve.  The tool can help the nurse in generating a written summary for ePerformance submission.  This is a tremendous time saver and improves the quality of their submission.  Most importantly, the Custom GPT does not impact the staff rating.  It is a tool is designed to help the nurse.  The nurse is ultimately responsible for the content and final submission (data accuracy and validity), and the proficiency evaluations are the responsibility of the Supervisor with knowledge regarding the staffs performance.  The improvment in content can greatly assist the Supervisor in their evaluation process (win-win).      

16_dev_stage: Implementation and Assessment
17_impact_type: Neither
18_date_initiated: 8/20/2024
19_date_acq_dev_began: 8/27/2024
20_date_implemented: 10/5/2024
22_dev_method: Developed in-house.
24_hisp_support: No
27_public_info: No
29_contains_pii: No
30_saop_review: No
31_data_catalog: No
33_agency_data: 
Nursing Functional Statements

34_data_docs: Documentation is missing or not available: No documentation exists regarding maintenance, composition, quality, or intended use of the training and evaluation data.
37_custom_code: Yes
38_code_access: No – agency does not have access to source code.
40_has_ato: No
41_system_name: Custom ChatGPT paid for by owner, external to VA. 
42_dev_tools_wait: Less than 6 months
43_infra_provisioned: No
45_compute_request: No
47_timely_resources: Other
47_question_type: 
N/A, externally developed Custom ChatGPT paid for by the employee for nurse use.

49_existing_reuse: None: This use case does not re-use any internally developed tooling or managed infrastructure from any other AI development efforts within the agency.
50_internal_review: No documentation is available: No documentation detailing model performance metrics, model architecture, features and intended use of the models have been created or are currently accessible to other data science teams within the agency.