# Presentation: 434820

## Software Product Assurance (PA)R&D Road mapping Activities

**ESA/ESTEC****TEC-QQS**

- QQ Division Meeting

- 21 January 2005

## Challenges Ahead

**Mission Needs**
- Increase in complexity
- Demand for reliable, available, maintainable and safe software systems
- Push for higher efficiency (more for less)
**Rapid evolution in software engineering**
- Modern lifecycle approaches
- Concurrent software engineering
- Prototyping
- Open source

- QQ Division Meeting

- 21 January 2005

**Notes:**
The aim of establishing SW PA R&D objectives, milestones and timelines is to prepare us fulfil our function of ensuring quality in software processes and products in the face of:
Increasingly demanding mission needs
Technical: Complex, mission-critical, safe, reliable SW
Financial: stringent budget and schedule
Rapidly evolving in software engineering
Evolutions --- and revolutions --- in engineering techniques, methods and tools call for suitably adjusted SW PA techniques, methods and tools
Satisfy customer requirements and expectations
Consistently repeat quality within and across projects
So, a reasoned, justified SW PA R&D initiative could be regarded as a
Powerful facilitating factor,
Providing the right orientation
To allow SW PA cope with the challenges ahead
To promote a high readiness state
R&D may determine the efficiency and effectiveness of SW PA

## Guiding Principles

**Future Missions’ Needs**
- High Reliability
- Reuse
**Technologic/Strategic Drivers**
- Dependability
- Security and Safety
- Non-Dependence
- Leadership
**ESA Objectives**
- Enabling Technologies
- Methods, Tools and Standards
- Enhance PA’s Effectiveness and Efficiency

- QQ Division Meeting

- 21 January 2005

**Notes:**
We have identified three reference points to support and guide us in establishing SW PA R&D objectives and plan to achieve them:
Our estimation of future mission needs, using technology dossiers and description of mission objectives 
Technologic and strategic drivers as e.g. identified by in WGs
ESA stated objectives at organizational level and further refined at department and division level
Paraphrase slide
Leadership as strategic driver
Take maximum advantage of the SW PA studies performed and on-going in ESA
RAMS
Process assessment
Reuse
Open source
Web-based applications
Auto coding
Combination of RAMS techniques and methods
Good bearings are required to arrive to the desired destination

## SW PA R&D Roadmap

**Support steering progress to meet future challenges**
**Establish the foundation**
- Implementation plans
- Prioritisation
- Resource allocation
**Structured**
- Areas of software product assurance R&D
- Objectives for each area

- QQ Division Meeting

- 21 January 2005

**Notes:**
We know where we want to go; Be ready and master the challenges ahead
We have good bearings; Mission needs, drivers, ESA objectives
First step: Set the course of action
Specific objectives, consequent with challenges and references
Foundation for plans, priorities and resource allocation
Structured
Around areas of R&D
Further refinement in concrete objectives from which to derive implementation plans
Milestones
Timelines

## Coordination ESA – European National Space Agencies - Industry

**Workshop ESA-Industry on software PA R&D road mapping**
- Enable dissemination of information
- Foster open discussion
- Facilitate the preparation of ESA’s R&D roadmaps to meet the future demands concerning software product assurance, embracing all perspectives
- Enhance industry’s product assurance effectiveness in ensuring the required high quality levels characterizing space software applications

- QQ Division Meeting

- 21 January 2005

**Notes:**
We know where we want to go; Be ready and master the challenges ahead
We have good bearings; Mission needs, drivers, ESA objectives
First step: Set the course of action
Specific objectives, consequent with challenges and references
Foundation for plans, priorities and resource allocation
Structured
Around areas of R&D
Further refinement in concrete objectives from which to derive implementation plans
Milestones
Timelines

## SW PA R&D Roadmap: Areas of R&D

**Identified areas that require software product assurance R&D**
- Dependability and security in software intensive systems
- Processes and management
- Reuse
- Support to engineering
- Product quality
- Ground segment
- Operations and maintenance

- QQ Division Meeting

- 21 January 2005

**Notes:**
Paraphrase slide

## SW PA R&D Roadmap: Objectives (1/6)

**Dependability and security in software intensive systems**
- To develop:
- methods ensuring high-reliability software systems
- effectively combinations of software RAMS techniques and methods
- methods in support of distributed, dependable hard real-time systems
- fault tolerant mechanism and protocols to reduce vulnerability
- an approach to estimate security risks based on the detection of implementation vulnerabilities in software systems security strategies
- software PA methods for security-focussed software development processes
- security-based risk assessment methods
- security evaluation methods and measurements for open source and COTS software

- QQ Division Meeting

- 21 January 2005

**Notes:**
RAMS: continuation of a series of activities in ESA directed to a increased understanding of suitability and impact on quality of techniques and methods
Mission-critical requiring high-reliability
Distributed, dependable hard real time systems
Combination of techniques and methods for efficiency (productive without waste) and effectiveness (producing desired effect)
Processes: Continuation of a series of activities in ESA around process definition and assessment with a view to determine the level of maturity or allow the definition of process improvements. Two areas to be initiated: Paraphrase slide bullets
Reuse: Continuation of a series of activities directed at gaining insight on constraints and conditions that software should display for successful reuse in determined classes of space applications. Paraphrase slide bullets

## SW PA R&D Roadmap: Objectives (2/6)

**Processes and management**
- To develop:
- standard process models including quality assurance
- software project risk management based on software process assessment
- a software quality assurance approach for FPGA and ASIC design
- safety and dependability process assessment models
- quantitative measurements of the benefits of process assessment and improvement
- a space specific software risk taxonomy
- an approach to risk based software process improvement
- requirements and criteria for personnel qualification
- a metrication framework for software processes

- QQ Division Meeting

- 21 January 2005

**Notes:**
RAMS: continuation of a series of activities in ESA directed to a increased understanding of suitability and impact on quality of techniques and methods
Mission-critical requiring high-reliability
Distributed, dependable hard real time systems
Combination of techniques and methods for efficiency (productive without waste) and effectiveness (producing desired effect)
Processes: Continuation of a series of activities in ESA around process definition and assessment with a view to determine the level of maturity or allow the definition of process improvements. Two areas to be initiated: Paraphrase slide bullets
Reuse: Continuation of a series of activities directed at gaining insight on constraints and conditions that software should display for successful reuse in determined classes of space applications. Paraphrase slide bullets

## SW PA R&D Roadmap: Objectives (3/6)

**Reuse**
- To develop:
- quality assurance approaches for building block-based software systems
- quality assurance approaches for Open Source software (OSS)

- QQ Division Meeting

- 21 January 2005

**Notes:**
RAMS: continuation of a series of activities in ESA directed to a increased understanding of suitability and impact on quality of techniques and methods
Mission-critical requiring high-reliability
Distributed, dependable hard real time systems
Combination of techniques and methods for efficiency (productive without waste) and effectiveness (producing desired effect)
Processes: Continuation of a series of activities in ESA around process definition and assessment with a view to determine the level of maturity or allow the definition of process improvements. Two areas to be initiated: Paraphrase slide bullets
Reuse: Continuation of a series of activities directed at gaining insight on constraints and conditions that software should display for successful reuse in determined classes of space applications. Paraphrase slide bullets

## SW PA R&D Roadmap: Objectives (4/6)

**Support to engineering**
- To develop:
- testing suite adequacy criteria, methods for software intensive systems
- new software PA methods and techniques in support of evolving software development methods and techniques
- a quality assurance approach for automatic code generation
- a quality assurance approach for proof-based systems
- techniques in support of system evolution
- a quality assurance approach for network- and web-based systems
- PA approaches to support agile development models

- QQ Division Meeting

- 21 January 2005

**Notes:**
Support: Keeping up with system and software engineering evolutions, in addition to improving SW PA techniques and methods applied to more traditional SW engineering approaches. Paraphrase slides with extended comments for:
Automatic code generation
Testing suite adequacy (quality)
SW PA for network-based systems
Certification: *** thinking ***

## SW PA R&D Roadmap: Objectives (5/6)

**Product quality**
- To develop:
- software product certification requirements and process
- approaches for assuring product quality by engaging third party organizations that ascertain the fulfilment of product quality criteria and produce a written statement as part of the product’s quality evidence
- metrication programs and quality models with emphasis on establishing target values for metrics and clear links between metrics and quality objectives (e.g. for object oriented developments). Requirement quality modelling and metrics
- reliable reliability models for safety- and dependability-critical software components

- QQ Division Meeting

- 21 January 2005

**Notes:**
Support: Keeping up with system and software engineering evolutions, in addition to improving SW PA techniques and methods applied to more traditional SW engineering approaches. Paraphrase slides with extended comments for:
Automatic code generation
Testing suite adequacy (quality)
SW PA for network-based systems
Certification: *** thinking ***

## SW PA R&D Roadmap: Objectives (6/6)

**Ground segment**
- To develop:
- software PA approach for large ground segments using contracted communication services
**Operations and maintenance**
- To develop:
- a software PA approach for operations and maintenance phases

- QQ Division Meeting

- 21 January 2005

## Summing up

**Meet future mission needs in line with ESA goals**
- Define objectives to guide software PA R&D efforts.
- Justify objectives: Relate to missions, ESA objectives, drivers
- Describe objectives to allow preparation of implementation plans
- Early active involvement and contribution from industrial partners

- QQ Division Meeting

- 21 January 2005