ARTIFICIAL INTELLIGENCE IN NORTH-RHINE-WESTPHALIAAPPLIED AND TRUSTWORTHY AI MADE IN NRW
Dr. Dirk Hecker | KI.NRW and Fraunhofer IAIS | Japan-Tag | May 2019amiak / Fotolia.com© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Soccer Worldcup 2018
Worldchampion in Footb…. in Artificial Intelligence2© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Thesis 1
Future AI can do without big data

Conventional machine learning meets limits:
Where only few data is available for learning
Where much of data is irrelevant

Amount of raw dataWhere phenomena are too complex for current
machine learning methods
Video: fotolia/Federico3D

Amount of useful data

This is rather typical for indus trial and healthcare applications

3© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

StrategyHybrid AI combines learning from data with domain knowledge
Text mining and semantic technologies
extract knowledge graphs from text
Benefits
Text

KnowledgegraphsPerformant models despite of few data
Easier transfer to new tasks

Numerical simulations create moredata for machine learning

Differentialequations

4© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Numericalsimulation

Improved transparence and validation

Example 1: Exploiting numerical simulations
Syngenta Crop Challenge 2019

How will we be able to grow enough food tomeet world demand?
Task: Aggregate environmental data into metrics
representing stresses encountered by different
hybrids of corn
Approach: Combination of expert knowledge andneural networks

ExpertPhysicalprocess model
1st prize won by team from Fraunhofer IAIS
and agricultural expert from Univ. of BonnFine tune parameters

Heat anddrought data5

Deep neuralnetwork© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Predict stress foreach hybrid

Example 2: Exploiting knowledge from text
Symptom-Diagnosis-Recommender

Hybrid approach

Knowledge base

Demonstrator

Combined model

Input form

Slinking symptoms todiagnoses

Enter symptoms to findrelated diagnoses

Crafted lexikosemantic rules
Experts design linguistic rules to extract
relations between symptoms anddiagnoses

Machine learning
Trained to detect pieces of text probably
containing symptoms or dignoses

Seite 6© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Thesis 2
Future AI is decentral

Today’s centralized machine learning is:
Not scalable enough: communication
costs exceed practical limits
Not responsive enough: too much delay
induced by communication

Not private enough: sensitive
information leaves the sensor

This is rather typical for applications in the Internet of Things

7© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Strategy
Federated learning at the edge exchanges models instead of data

Benefits:
Reduced communication
No sharing of private data
Combine models

Less central data increases
security
Efficient usage of local
computing resources
Learning scales with numberof streams
No big loss of learning
accuracy

8Image-Sources: www.flaticon.com, by Freepik, Smashicons, Gregor Cresnar© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Example
Google assistant goes offline

News from Google‘s developer conference I/O
2019Soon the assistant can run offline onsmartphones
No more access to the cloud is neededAnswers will be 10 times faster
Memory needs could be reduced from 100
Gigabyte to 0,5The exact methods were not explained

9© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Thesis 3
Artificial Intelligence is the New User Interface
Haptic Interfaces get replaced by voice

SIMPLE, INTUITIVE, FAST
Seite 10
© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Thesis 3
Voice is the new user interface
Haptic interfaces are being substituted by voiceassistants:
Speech recognition reached human level in 2016
Speech synthesis has become natural as well
Conducting dialogues is making progress: small
talk, question answering, negotiating tasks

Voice assistants will also pervade professional life11© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

StrategyA sovereign and customizable speech platform for German

Benefits
Speechrecognition

SpeechVoice data will be trained in secure data spaces

synthesis
Compliance with EU data protection regulation
GDPR

Dialog system

QuestionAnswering

12 Image-Sources: www.flaticon.com, by Freepik, Smashicons, Gregor
Cresnar© Fraunhofer-Allianz
Big Data und Künstliche Intelligenz

The common platform creates synergies
between applications in different sectors, suchas fewer training data

KnowledgegraphsVocabularies and knowledge graphs facilitatecustomization for specific application areas

Examples
Voice assistants for citizens

A voice assistant to apply for parents money

By Fraunhofer IDMT and FOKUS

13© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Realtime life captioning

By Fraunhofer IAIS

Thesis 4
Future AI is trustworthy
Especially modern deep learning from big data
produces black box models. They are very
accurate, but:

Voice assistants

Cannot explain their results

Adopt prejudices contained in the data
Can be manipulated by imperceptible
modifications of the inputThis concerns especially com puter v is ion and v oice as s is tants
14© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Bild: Clark, MISTIThesis 4
Future AI is trustworthy
Especially modern deep learning from big data
produces black box models. They are very
accurate, but:

Cannot explain their results

Voice assistants»…cried out. In his anger and his shame "I am leaving, I
am leaving“ but the fighter still remains«

Adopt prejudices contained in the data
Can be manipulated by imperceptible
modifications of the input»Activate emergency break and lock all doors«

This concerns especially com puter v is ion and v oice as s is tants
15© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Strategy
Negotiate standards for trustworthy AI between ethics, law and computerscience
Main challenges
LawEthics

Computer science How to impose
regulations that aretechnically feasible

 How to fill in the gapsthat have not yet been
regulated How to safely deploy
modules that generate
output with uncertainties

 How thus to shape ourfuture digital society How to assign
accountability between
human and machine How to control learning
during service

Prof. Rostalski, Cologne

Prof. Gabriel, Bonn16© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Example
An open catalogue with criteria for trustworthy AI from KI.NRW

Ethics & law:

Is it ethical and legal to use the AI application for the intended purpose?
If so, under which constraints?

Fairness

Reliability

Autonomy & Control

Security & Safety

Transparency

Privacy17© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Thesis 5
Demand for Data Scientists and AI Engineers will increase further

The Internet of Things brings the next wave ofbig data: 30 billion connected devices in 2020.
Until 2023 Germany alone will need:+ +700.000 IT ex perts
Among them + 455.000 data s cientis ts andAI engineers+ 2,8 m illion pers ons to obtain bas ic
digital s kills

This concerns com panies and especially S MEs .
18© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Strategy
Excite children, increase academic programs, train professionals

Digital education w ith Roberta"Open Roberta " motivatesevery child to intuitively
program robots andmicrocontrollers.

Academ ic education

New professorships
Focused doctoral programs
Hands-on labs with industrial
use cases19© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Data S cientis t Training

For managers, businessdevelopers, engineersTell me and I forget.
Show me and I remember.
Involve me and I understand.

Seite 20
© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Confucius 551 - 479 AD

European pioneer in educational and professional qualification
We educate designers not users

Students reached inroberta courses

Certified Robertateachers

Roberta®-facilities
nationwide

Seite 21
© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Programmers peryearYears experience inSTEM

Cooperations at EU andnational level

Innovative open source
programming platformExample
Training data scientists

Excitement

Seminars on trends, potentials
and challenges of AI

Seite 22
© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

Methods &applications
Method-specific andapplication-specific trainings

Cerfiticates

Modular program withcertificates on three levels ofexpertiseUpshot
Applied and trustworthy AI made in NRW
We do no »me-too AI« in NRW

We are approaching AI from a European perspective and focus on the needs of our industry in NRW This means especially exploiting the deep knowledge of our engineers for »hy brid AI«
 With »AI at the edge« we react to the special needs of our strong industrial sector: mechanical engineering With v oice as s is tants we ensure the digital sovereignty of our companies
We design AI with European values in mind creating a special brand of »AI m ade in Germ any « This includes elaborating a catalogue of requirements for the certification of trustworthy AI
We want designers, not users, and educate them with the Roberta initiativ e23© Fraunhofer-Allianz Big Data und Künstliche Intelligenz

“DO MORE WITH DATA!“Schloss Birlinghoven
53757 Sankt Augustin
www.ki.nrw

Contact Person
Dr. Dirk Hecker
Managing Director Fraunhofer-Allianz Big Data and Artificial Intelligence
Deputy Director of Institute Fraunhofer IAIS
Telefon: +49 (0) 2241 14-1509
E-Mail: dirk.hecker@iais.fraunhofer.de24© Fraunhofer-Allianz Big Data und Künstliche Intelligenz