NIST AI Activities 

Chuck Romine

June 4, 2019

1
Cultivating Trust in IT and Metrology

2
ITL’s work

Fundamental 

Research

Applied 

Research

Standards + 

Best Practice 

Guides

Adoption

Image Credit: wsj.com

3
Fundamental and Applied Research and 

Standards for AI Technologies (FARSAIT) 

Applied

Catalyzing the use of machine learning 

and AI within NIST scientific program.

Fundamental

Measure and enhance the security 

and trustworthiness of AI systems.

4
Interagency coordination

5

MLAI Subcommittee

Chaired by NIST, OSTP, DoE

AI Select Committee

Chaired by OSTP, NSF, DARPA

Networking and Information 

Technology Research and 

Development (NITRD) AI 

Interagency Working Group 
Trustworthy AI

6
Trustworthy AI

accuracy reliability

robustness

privacy

explainability

7
Secure AI

Terminology and Taxonomy of 

attacks and defenses for 

Adversarial Machine Learning. 

Draft for public comment 

planned for September 

2019.

Collaboration with MITRE.

Extensive literature survey.

8
Explainable AI

Forms the bases of addressing 

fairness, bias, transparency, 

security, safety and ultimately 

trust in AI systems. 

Draft for public comment 

planned for January 2020.

Developed principles of 

explainable AI.

Socialize with experts in the 

community.

9
Federal Engagement in Artificial 

Intelligence Standards Workshop

10
Executive Order on Maintaining American Leadership in AI

Within 180 days of the 

date of this order,

www.whitehouse.gov/presidential-actions/executive-order-maintaining-americanleadership-artificial-intelligence/

NIST is tasked with developing a plan for 

Federal engagement in the development 

of technical standards and related tools 

in support of reliable, robust, and 

trustworthy systems that use AI 

technologies. 
Our approach and timetable 

Request for information, May 1, 

2019. Closes on June 10, 2019. “NIST’s efforts will support the 

development of standards for AI 

that reflect federal priorities for 

innovation, public trust and 

confidence.”

Workshop on May 30, 2019.

Draft Plan for public comment, 

late June.

www.nist.gov/topics/artificial-intelligence/ai-standards 12
6/3/2019 13

Request For Information

What’s out there 

already? What’s in the 

works?

Topic Area 1

What do we really need 

the most that we don’t 

yet have?

Topic Area 2

What can and should 

the federal government 

do first and foremost?

Topic Area 3

current status and plans needs and challenges role of federal agencies
Federal Engagement in Artificial Intelligence Standards Workshop

Purpose

Engage private and public sector 

organizations and individuals in discussions 

that advance the development of a plan for 

Federal engagement in AI standards.

Outcome

Annotated outline of a plan for Federal 

engagement in the development of 

technical standards and related tools

www.nist.gov/topics/artificial-intelligence/ai-standards
Workshop format

What’s next in 

standards setting for AI

Panel Session (am)

What AI standards are 

needed by Federal 

government agencies? 

Panel Session (pm)

How should the Federal 

government engage?

Breakout Session (pm)

What’s out there 

already? What’s in the 

works?

Breakout Session (am)

15
Draft outline 

May 30: 

Discussed and annotated the outline.

Late June: 

Draft for public comment.

www.nist.gov/topics/artificial-intelligence/ai-standards
By Numbers

17

>100 

ENTITIES

217

WORKSHOP 

ATTENDEES

6

BREAKOUT 

SESSIONS

34+

RFI 

RESPONSES

2

DOCUMENTS

67

DAYS TILL 

DEADLINE
1.

2.

3.

4.

Moving forward

June 10: RFI closes.

June 19: Distribute draft Plan to 

federal agencies for review.

July 1: Distribute draft for 

public review.

July 30: Final report for 

clearance.

www.nist.gov/topics/artificial-intelligence/ai-standards
QUESTIONS?

19
20

STAY IN TOUCH

#NISTAIStandardsPlan

ai_standards@nist.gov

www.nist.gov/topics/artificial-intelligence/ai-standards