DISTRIBUTED DATA- AND SERVICEECOSYSTEMS FOR V&V

Prof. Dr. Frank Köster
DLR-Institute for AI Safety & Security – Sankt Augustin and Ulm

PEGASUS Family
PEGASUS + SET-Level + V&V Methods▪ Methods and tools to test automated driving systems (highways and in urban environments)

VV-Methods• Scope: Methods, toolchains, specifications
for technical assurance• Use-Case: L3/4/5 in urban environments• Partners: 23 partners• Timeline: 07/2019 – 06/2023

PEGASUShttps://www.pegasusprojekt.de/en/home• Scope: First methodological framework• Use-Case: L3/4 on highways• Partners: 17

SET Level

PEGASUS Family:
https://www.pegasusprojekt.de/en/home• Scope: Simulation platform, toolchains,definitions for simulation-based testing• Use-Case: L3/4/5 in urban environments• Partners: 20 partners• Timeline: 03/2019 – 10/2022+ future projects of the PEGASUS Family
20162019

Time
2

Prof. Dr. Frank Köster, Institute for AI Safety and Security

PEGASUS Family
PEGASUS + SET-Level + V&V Methods▪ Methods and tools to test automated driving systems (highways and in urban environments)
CapabilityLayer

Operational Concept

Design & Implementation

Verification &Validation

Engineering
Layer

PEGASUS Family:
https://www.pegasusprojekt.de/en/home

Demonstrators

ModelsStandards

Tools andTool Chains

Architecture

Test-Cases andSimulation Targets

Methods

Processes

Simulation-BasedEngineering Tasks

Real-World
Layer+ future projects of the PEGASUS Family
2016

2019

Time3

Prof. Dr. Frank Köster, Institute for AI Safety and Security

PEGASUS Family – Focus on SET-LevelPEGASUS + SET-Level + V&V Methods▪ Beside real-world data also synthetic data are of growing relevance▪ Collect and refine requirements▪ Investigate and understandfield observations – rootcause analysis
Project.

▪ …

Configuration Management

Traceability Tool

Simulation (Scenario) Control

Run

Simulation Task /Experiment

MIL / SIL
System Under Test

Simulation
Configuration →Integration of Digital
Twins

Simulation Platform Control

Proving
GroundSimulation System
Extension

PublicRoads…
ResultCompilation
ReportingBased on: F. Köster, S. Hallerbach, P.R. Mai, B. Engel:
ASAM SIM:Guide: ASAM OpenX in Context, 2021. Refined in theInterfaces & Datastructures
Generic BusDT…

4Prof. Dr. Frank Köster, Institute for AI Safety and Security

Digital Twins

Evaluation
Algorithms

Log Processing
DigitalTwinStoreHIL / PIL /VIL

Operational
Environment

Repository
TracesPost-Process

Execution

Simulation Core▪ Prepare training & validation data
▪ Completion of safety argumentation▪ Define deployment strategies

Management Interface

Retrieve

ScenariosSafeguard AI-based Perception Functions

Methods and measures tosafeguard AI-based perceptionfunctions
Data
Expertise

Information

SmartSystem

Processes, methods and tools
for generating and enriching
training and validation
data

Knowledge
SkillsFunctionsIntegration of knowledge
with machine learning
methodsExpansion and transformation ofexisting AI modules according to newrequirements

Plan5

Prof. Dr. Frank Köster, Institute for AI Safety and Security

Playing Field
Striving for Safety and Security

Operational
Framework & Procedures

DataIntended
Functionality

AIbased
Function

Methods+ Tools

AI-Engineering

Algorithms

Knowledge

Operational
Design Domain& Environment

6Prof. Dr. Frank Köster, Institute for AI Safety and Security

Humansin the Loop

DevOpsPlaying Field

Striving for Safety and Security … but can we win?

Continuous
Improvement
Safe / Secure

Operational
Framework & Procedures

Fail Safe / Secure
Data

Intended
FunctionalityAIbased
Function+ Tools

AI-Engineering

Algorithms

Fail Operational
Humansin the Loop

DevOpsFunctional Degradation
Methods

Knowledge

Operational
Design Domain& Environment

Self Healing

Resilience

7

Prof. Dr. Frank Köster, Institute for AI Safety and Security

It’s not Done when it’s Done!

There is no One-Shot Solution → DevOps … and … Digital Twins are Essential

Collect and refine
requirements – e.g.
identify scenariosand define ODD
Implement function
or prepare training andvalidation Data

Deploy – following a
deployment strategy

Plan following
increment

DT…

Operate & collectfield and performancedata

Compile for target-systemor build AI based on
training and validation
dataMonitor, assess andevaluate the function’s orAI‘s performance

Overall quality
management andprocess improvement

ReleaseTest – e.g. contributeto safety approval

8Digital
Twin

Prof. Dr. Frank Köster, Institute for AI Safety and Security

Post-process field andperformance data

Data- and Service-Ecosystems & Data Spaces ()▪ Open cloud/edge-based data and service-ecosystems will be the “home” of many digital services/products that will more and more rely on AI-based components – e.g. GAIA-X▪ GAIA-X will be the basis for a digital ecosystem in which data and services can be made available,
integrated/merged, shared and used securely and with an ultimate level of trust.
▪ Based on European values, GAIA-X implements the following
guiding principles:

Finland▪
▪
▪
▪
▪

data protection (European standards)
Denmark
ultimate authenticity and trust
Austria
sovereignty and self-determination
Franceopenness and transparency
Belgium
Estonia
free market access as well as
European stability and growthGreecePoland▪ modularity and interoperability
Germany▪ usability▪ European/international visibilityand impactIreland

Prof. Dr. Frank Köster, Institute for AI Safety and Security

Netherlands
Luxembourg

Slovakia

PortugalSpain

Slovenia
USASwedenGreat Britain

9ItalySouth Korea

ChinaJapan…

…

Data- and Service-Ecosystems & Data Spaces ()▪ Data Spaces | Data- and Service-Ecosystems
Use Cases

Other DLR Institutes

Immateriell
EntityProjects / Cooperation &Collaboration with external
Partners
Eco-System– Core Services

Future Entities…

Information

Institute for AI Safety& Security / Departments

Data Plane

Meta Data

10

Prof. Dr. Frank Köster, Institute for AI Safety and Security

Family of Projects – Relation to other Domains / Initiatives
Hannover Messe | 22.-26. April
2024 | Hall 8 | Booth F25

Agriculture

EnergyEnergyFinanceFinance

Geoinformation HealthHealthGeoinformation

Prof. Dr. Frank Köster, Institute for AI Safety and Security

Industry
4.0/SME

Mobility

PublicSectorSmart City/Region

Smart
LivingPlan/Build/Operate

11Family of Projects – Synergies by Design
Hannover Messe | 22.-26. April
2024 | Hall 8 | Booth F25

Use-cases on Different
System Levels
Node, Corridor and Vehicle…

Backend
SystemTrafficNetwork

Subsystem

Component

RO of Vehicles
RO of Fleets
Smart Managed Public Transport Fleet
Smart Managed Freight Fleet

Vehicle as Edge Device
Embedded Gaia-X

Vehicle and Components…
DLT-Network
Traffic Infrastructure Mgmt.
Smart Parking
ZoningVehicle Data Collection

Sensor Validation
Bullwhip Mitigation
Digital Twin based Predictive Maintenance

Manuf. of Vehicels + Components…

…
Tools and Tool Chains

Vehicle System

Safe/Secure Cooperation of Automated Vehicles
Connected and Safe/Secure – Rescue Corridor

Traffic System, City and Vehicle…

Traffic Systems… Components, User

Traffic Nodes /Edges…

Prof. Dr. Frank Köster, Institute for AI Safety and Security

Automated…
OpticalDigital Twin – Camera… SIEM
Scenario Identification

Family of Projects – Synergies by Design
Hannover Messe | 22.-26. April
2024 | Hall 8 | Booth F25

Use-cases on Different
System Levels

Generalization and harmonizationof designs

Making benefitof synergies

Foundation for re-usablecomponents

Foundation for systeminnovation

Manuf. of Vehicels + Components…

Tools and Tool Chains

Prof. Dr. Frank Köster, Institute for AI Safety and Security

Joint development activities
and jointly
supported open
and freely available standards
as well as open
source developments

GovernanceTraffic Systems… Components, User

Semantic Model

Vehicle and Components…

Generic Components/Services

Traffic System, City and Vehicle…

Application-Specific Components/Services

Node, Corridor and Vehicle…

Shared designprinciples andreusablecomponents/
services

Practically relevant
design principles,standards andfunctionalcomponents/
services

Family of Projects – base-x Architecture
Hannover Messe | 22.-26. April
2024 | Hall 8 | Booth F25

Prof. Dr. Frank Köster, Institute for AI Safety and Security

Current Participants – Network
Hannover Messe | 22.-26. April
2024 | Hall 8 | Booth F25

Prof. Dr. Frank Köster, Institute for AI Safety and SecurityTHANK YOU
FOR YOUR ATTENTION

Contact
Prof. Dr. Frank Köster
German Aerospace Center
Lilienthalplatz 738108 Braunschweig
GermanyFrank.Koester@dlr.de