2_use_case_name: Generative AI Tools Pilot - Global Markets
3_agency: Department of Commerce
3_abr: DOC
4_bureau: ITA - International Trade Administration
8_topic_area: Diplomacy & Trade
10_commercial_ai: Improving the quality of written communications using AI tools.
11_purpose_benefits: Accelerate and streamline report production.
Enable analysts to focus on higher-level, strategic tasks rather than repetitive reporting.
Reduce costs and improve efficiency, leading to better client service and faster decision-making.
12_outputs: Generate initial drafts of market research reports incorporating public data sources
Provide data-driven insights to identify top markets and recommend strategic directions
Integrate with existing workflows, supporting analysts in refining and finalizing comprehensive, actionable reports
16_dev_stage: Acquisition and/or Development
17_impact_type: Neither
18_date_initiated: 2/3/2024
22_dev_method: Developed with contracting resources.
23_contract_piids: Planned or in Progress
24_hisp_support: No
28_iqa_compliance: All AI outputs will be considered first drafts only, requiring staff review for accuracy before release. This provides a critical check to catch and correct any inaccuracies, preventing their wider dissemination. The information obtained through the generative artificial intelligence pilot will be subject to existing Information Quality Act guidelines.
29_contains_pii: No
30_saop_review: Yes
31_data_catalog: No
33_agency_data: TBD
34_data_docs: Documentation is missing or not available: No documentation exists regarding maintenance, composition, quality, or intended use of the training and evaluation data.
35_demo_features: Other
35_question_type: Does not use any demographic variables.
37_custom_code: No
38_code_access: No – agency does not have access to source code.
40_has_ato: No
41_system_name: TBD
42_dev_tools_wait: Less than 6 months
43_infra_provisioned: Other
43_question_type: Planning to use a COTS product, no IT infrastructure is required
45_compute_request: Other
45_question_type: Planning to use a COTS product, no IT infrastructure is required
47_timely_resources: Other
47_question_type: Planned or in-progress
49_existing_reuse: None: This use case does not re-use any internally developed tooling or managed infrastructure from any other AI development efforts within the agency.
50_internal_review: No documentation is available: No documentation detailing model performance metrics, model architecture, features and intended use of the models have been created or are currently accessible to other data science teams within the agency.
51_extension_request: No – Agency did not request an extension for this use case.
52_impact_assessment: Planned or in-progress.
53_real_world_testing: No testing: No testing of the model to simulate performance in an operational environment has been conducted thus far.
54_key_risks: N/A - Users will be required to take all reasonable action to validate response from the generative AI tool
55_independent_eval: Planned or in-progress
56_monitor_postdeploy: No monitoring protocols have been established: Necessary infrastructure needed to perform monitoring of AI systems in production is not available and/or a plan to monitor models has not yet been established.
57_autonomous_impact: No - Some individual decisions or actions require direct human oversight.
59_ai_notice: N/A - individuals are not interacting with the AI for this use case
59_question_type: The use of the generative AI tool is not public-facing
61_adverse_impact: No
62_disparity_mitigation: N/A - The generative AI tool will not be leveraged in a way that results in this type of disparity
63_stakeholder_consult: Direct user testing
65_appeal_process: No – it is not operationally practical to offer this.
66_no_appeal_reason: N/A - The use of the generative AI tool will be user-led
67_opt_out: Other
67_question_type: Users will opt-in to the pilot