2_use_case_name: Immunization Information Systems Guidance Documentation Navigation and Management (IDAB EDAV Azure OpenAI Technology Use)
3_agency: Department of Health and Human Services
3_abr: HHS
4_bureau: CDC
8_topic_area: Mission-Enabling (internal agency support)
10_commercial_ai: None of the above.
11_purpose_benefits: This AI solution (chatbot) helps with retrieving information and updating guidance documentation by increasing interactivity and discoverability of information in the Immunization Information Systems (IIS) domains of HL7 electronic data exchange standards, CDSi (Clinical decision support for immunizations), and IIS operational best practices. It provides a modernized approach to knowledge retrieval and real-time guidance, as well as support the creation of new guidance by leveraging the AI capabilities in natural language processing and content generation to draft, refine, and validate new guidance documents efficiently and accurately.

This AI solution creates a better, faster, and more actionable method for IIS SMEs to obtain IIS guidance from previously published and publicly available IIS documentation. This solution will provide a more modernized approach to knowledge retrieval and real-time guidance, as well as support the creation of new guidance by leveraging the chatbots capabilities in natural language processing and content generation to draft, refine, and validate new guidance documents efficiently and accurately.
This AI solution (chatbot) provides an efficient and user-friendly way to search, interact, and update these IIS guidance documents. It can help experts answer questions faster, new employees find information more easily, and employees better understand best practices.
12_outputs: This AI solution (chatbot) uses Retrieval Augmented Generation (RAG) to retrieve and synthesize information from a limited set of publicly available IIS guidance documents related to the HL7 Electronic Exchange Standard specification, Clinical Decision Support for Immunization (CDSi) and IIS Operational Best Practices. It does this using a Question-and-Answer style interface, allowing team members to retrieve answers in an efficient and user-friendly way.
On 07/26/2024 the CDC Information Technology and Data Governance (ITDG) Executive Committee has approved this investment “to use AI to create a system that can conduct a dialogue with a user and answer questions about the contents of already approved public documents”.
16_dev_stage: Acquisition and/or Development
17_impact_type: Neither
18_date_initiated: 10/1/2022
19_date_acq_dev_began: 8/1/2024
20_date_implemented:  
21_date_retired:  
22_dev_method: Developed with both contracting and in-house resources.
23_contract_piids: 75D301-22-C-13291, 75D30124C20195
24_hisp_support:  
25_hisp_name:  
26_public_service:  
27_public_info:  
28_iqa_compliance:  
29_contains_pii:  
30_saop_review:  
31_data_catalog: No
33_agency_data: We did not do any training or fine tuning, but we used the following materials to evaluate the chatbot: HL7 Documentation Data, CDSi Logic Specification 4.4 Data. This information is entirely publicly accessible.
34_data_docs: Documentation is widely available
37_custom_code:  
38_code_access:  
39_code_link:  
40_has_ato: Yes
41_system_name: Enterprise Data Analytics and Visualization (EDAV) Platform
42_dev_tools_wait: Less than 6 months
43_infra_provisioned: Yes
45_compute_request: Yes
47_timely_resources: Yes
49_existing_reuse: Re-use production level code from a different use-case: This use case re-uses production level code and/or internally developed code libraries for model development from existing AI systems or repositories inside the agency.
50_internal_review: Documentation has been developed: Complete documentation detailing model performance across a range of benchmarks, architecture, relevant features and information regarding the appropriate use of the model for predictive tasks has been created.