AI Development Practices Act of 2024

Bill: 118-hr-9466
Sponsor: full_name: Rep. Baird, James R. [R-IN-4]
Introduced: 2024-09-06
Policy area: Science, Technology, Communications
Subjects: Advanced technology and technological innovations

Computer security and identity theft

Computers and information technology

Economic performance and conditions

Public-private cooperation

Technology assessment
Latest action: action_date: 2024-09-11
text: Ordered to be Reported by Voice Vote.

Summaries:

tv_txt: I 118th CONGRESS 2d Session H. R. 9466 IN THE HOUSE OF REPRESENTATIVES September 6, 2024 Mr. Baird (for himself and Mr. Lieu ) introduced the following bill; which was referred to the Committee on Science, Space, and Technology A BILL To direct the National Institute of Standards and Technology to catalog and evaluate emerging practices and norms for communicating certain characteristics of artificial intelligence systems, including relating to transparency, robustness, resilience, security, safety, and usability, and for other purposes.

1. Short title This Act may be cited as the AI Development Practices Act of 2024 . 2. NIST research on development best practices Section 22A of the National Institute of Standards and Technology Act ( 15 U.S.C. 278h–1 ) is amended— (1) by redesignating subsection (h) as subsection (i); and (2) by inserting after subsection (g) the following new subsection: (h) Assessment of the practices of artificial intelligence development (1) In general The Director of the National Institute of Standards and Technology (in this subsection referred to as the Director ) shall, subject to the availability of appropriations, develop, and periodically update, in collaboration with other public and private sector organizations, voluntary guidance for practices and guidelines relating to the development, release, and assessment of artificial intelligence systems. Such guidelines shall satisfy the following: (A) Define methods and guidelines for developing reasonable risk tolerances for various use cases of artificial intelligence systems based on the following: (i) The risks associated with the intended and unintended applications, use cases, and outcomes of the artificial intelligence system at issue, based on the guidelines specified in the voluntary risk management framework for trustworthy artificial intelligence systems, or successor framework, authorized under subsection (c), which may include different categories of risk, such as the following: (I) Security risks, including threats to national security. (II) Economic risks, including threats to economic opportunities. (III) Social risks, including infringement upon constitutional rights, privileges, or liberties. (ii) Such other factors as the Director determines appropriate and consistent with this subsection. (B) Categorize and list practices and norms for communicating relevant characteristics, including robustness, resilience, security, safety, fairness, privacy, validation, reliability, accountability, and usability, of artificial intelligence systems, and including any characteristics identified by the voluntary risk management framework for trustworthy artificial intelligence systems, or successor framework, authorized under subsection (c). Such practices and norms may relate to the following: (i) Documentation of training and evaluation datasets, such as information and statistics about a dataset’s size, curation, annotation, and sources, and the protocols for a dataset’s selection, creators, provenance, processing, augmentation, filters, inclusion of personally identifiable information, and intellectual property usage. (ii) Documentation of model information, such as a model’s development stages, training objectives, training strategies, inference objectives, capabilities, reproducibility of capabilities, input and output modalities, components, size, and architecture. (iii) Evaluation of benchmarks for multi-metric assessments, such as an assessment of an appropriate combination of robustness, resilience, security, safety, fairness, privacy, accuracy, validity, reliability, accountability, usability, transparency, efficiency, and calibration, and any characteristics identified by the voluntary risk management framework for trustworthy artificial intelligence systems, or successor framework, authorized under subsection (c). (iv) Metrics and methodologies for evaluations of artificial intelligence systems, such as establishing evaluation datasets. (v) Public reporting of artificial intelligence systems’ capabilities, limitations, and possible areas of appropriate and inappropriate use. (vi) Disclosure of security practices, such as artificial intelligence red teaming and third-party assessments, that were used in the development of an artificial intelligence system. (vii) How to release to the public components of an artificial intelligence system or information about an artificial intelligence system, including aspects of the model, associated training data, and license agreements. (viii) Approaches and channels for collaboration and knowledge-sharing of best practices across industry, governments, civil society, and academia. (ix) Such other categories as the Director determines appropriate and consistent with this subsection. (C) For each practice and norm categorized and listed in accordance with subparagraph (B), provide recommendations and practices for utilizing such practice or norm. (2) Implementation In conducting the Director’s duties under paragraph (1), the Director shall carry out the following: (A) Update the voluntary risk management framework for trustworthy artificial intelligence systems, or successor framework, authorized under subsection (c) as the Director determines appropriate. (B) Ensure that voluntary guidance developed in paragraph (1) is based on international standards and industry best practices to the extent possible and practical. (C) Not prescribe or otherwise require the use of specific information or communications technology products or services. (D) Collaborate with public, industry, and academic entities as the Director determines appropriate, including conducting periodic outreach to receive public input from public, industry, and academic stakeholders. (3) Report In conducting the Director’s duties under paragraph (1), the Director shall, not later than 18 months after the date of the enactment of this subsection, brief the Committee on Science, Space, and Technology of the House of Representatives and the Committee on Commerce, Science, and Transportation of the Senate on the following: (A) New or updated materials, programs, or systems that were produced as a result of carrying out this subsection. (B) Policy recommendations of the Director that could facilitate and improve communication and coordination between the private sector and relevant Federal agencies regarding implementing the recommended practices identified in this subsection. (4) Definitions In this subsection: (A) Artificial intelligence red teaming The term artificial intelligence red teaming means a structured testing of adversarial efforts to find flaws and vulnerabilities in an artificial intelligence system and identify risks, flaws, and vulnerabilities of artificial intelligence systems, such as harmful outputs from such system, unforeseen or undesirable system behaviors, limitations, and potential risks associated with the misuse of such system. (B) Artificial intelligence system The term artificial intelligence system has the meaning given such term in section 7223 of the Advancing American AI Act ( 40 U.S.C. 11301 note; as enacted as part of title LXXII of division G of the James M. Inhofe National Defense Authorization Act for Fiscal Year 2023; Public Law 117–263 ). .