2_use_case_name: Solicitation Review Tool (SRT)
3_agency: General Services Administration
3_abr: GSA
4_bureau: OGP
8_topic_area: Other
8_question_type: Section 508 Compliance
10_commercial_ai: None of the above.
11_purpose_benefits: The SRT intakes SAM.gov data for all ICT solicitations. The system then compiles the data into a database to be used by machine learning algorithms. The first of these is a Natural Language Processing model that determines if a solicitation contains compliance language. If a solicitation does not have compliance language, then it is marked as non-compliant. Each agency is asked to review their data and validate the SRT predictions. GSA also conducts random manual reviews monthly.
12_outputs: Determination whether a solicitation is compliant or not. Text form.
16_dev_stage: Implementation and Assessment
17_impact_type: Neither
18_date_initiated: 5/1/2018
19_date_acq_dev_began: 5/1/2019
20_date_implemented: 6/1/2020
22_dev_method: Developed with both contracting and in-house resources.
24_hisp_support: No
25_hisp_name: Public Experience Portfolio – GSA 
26_public_service: Enable increased self-service through an expansion of digital costumer service tools
27_public_info: No
28_iqa_compliance: Non-public
29_contains_pii: No
30_saop_review: No
31_data_catalog: Yes
33_agency_data: SAM.gov data sets
34_data_docs: Documentation is complete: Documentation exists regarding the maintenance, composition, quality, and intended use of the training and evaluation data, as well as any statistical bias across model features and protected groups. 
37_custom_code: Yes
38_code_access: Yes – agency has access to source code, but it is not public.
39_code_link: https://github.com/GSA/srt-fbo-scraper
40_has_ato: Yes
41_system_name: SRT
42_dev_tools_wait: 6-12 months
43_infra_provisioned: Yes
45_compute_request: Yes
47_timely_resources: Yes
49_existing_reuse: Use of existing data platforms: This use case is being developed on existing enterprise data and analytics platforms within the agency rather than procuring additional platforms or SaaS to operate.
50_internal_review: Documentation has been developed: Complete documentation detailing model performance across a range of benchmarks, architecture, relevant features and information regarding the appropriate use of the model for predictive tasks has been created.
51_extension_request: No – Agency did not request an extension for this use case.
52_impact_assessment: No
53_real_world_testing: Benchmark evaluation: Testing of the AI model has involved the use of benchmarks (either publicly available or internally created) to estimate performance in real-world settings, but has not been tested in an operational environment. 
54_key_risks: False negatives, and identified through random QA sessions.
55_independent_eval: Planned or in-progress
56_monitor_postdeploy: Intermittent and Manually Updated: A plan for monitoring the AI use case is in place, and requires data science teams to work with DevOps engineers to manually update models at scheduled intervals, and create metrics to detect data distribution shifts between the operational environment and the training data for the model. 
57_autonomous_impact: No - Some individual decisions or actions require direct human oversight.
59_ai_notice: N/A - individuals are not interacting with the AI for this use case
61_adverse_impact: No
63_stakeholder_consult: Post-transaction customer feedback collections
65_appeal_process: No – Law, operational limitations, or governmentwide guidance precludes an opportunity for an individual to appeal.
66_no_appeal_reason: Law, operational limitations, or governmentwide guidance precludes an opportunity for an individual to appeal.
67_opt_out: No – This AI use case is not subject to the opt-out requirement because the AI functionality is solely used for the prevention, detection, and investigation of fraud or cybersecurity incidents, or the conduct of a criminal investigation.