Testing Software and Systems

Valentina Casola, Alessandra de Benedictis, Massimiliano Rak

► To cite this version:

Valentina Casola, Alessandra de Benedictis, Massimiliano Rak. Testing Software and Systems: 32nd IFIP WG 6.1 International Conference, ICTSS 2020, Naples, Italy, December 9–11, 2020, Proceedings. Springer International Publishing, LNCS-12543, 2020, Lecture Notes in Computer Science, 978-3-030-64880-0. 10.1007/978-3-030-64881-7 . hal-03239808

HAL Id: hal-03239808

https://inria.hal.science/hal-03239808

Submitted on 27 May 2021

**HAL** is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
Founding Editors

Gerhard Goos

Karlsruhe Institute of Technology, Karlsruhe, Germany

Juris Hartmanis

Cornell University, Ithaca, NY, USA

Editorial Board Members

Elisa Bertino

Purdue University, West Lafayette, IN, USA

Wen Gao

Peking University, Beijing, China

Bernhard Steffen

TU Dortmund University, Dortmund, Germany

Gerhard Woeginger

RWTH Aachen, Aachen, Germany

Moti Yung

Columbia University, New York, NY, USA
More information about this subseries at http://www.springer.com/series/7408
Valentina Casola · Alessandra De Benedictis · Massimiliano Rak (Eds.)

Testing Software
and Systems

32nd IFIP WG 6.1 International Conference, ICTSS 2020
Naples, Italy, December 9–11, 2020
Proceedings

<figure><img src="image_2.png" /></figure>

Springer
Editors

Valentina Casola

University of Naples Federico II
Naples, Italy

Alessandra De Benedictis

University of Naples Federico II
Naples, Italy

Massimiliano Rak

University of Campania “Luigi Vanvitelli”
Aversa, Italy

ISSN 0302-9743

ISSN 1611-3349 (electronic)

Lecture Notes in Computer Science

ISBN 978-3-030-64880-0

ISBN 978-3-030-64881-7 (eBook)

https://doi.org/10.1007/978-3-030-64881-7

LNCS Sublibrary: SL2 – Programming and Software Engineering

© IFIP International Federation for Information Processing 2020

This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed.

The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use.

The publisher, the authors and the editors are safe to assume that the advice and information in this book are believed to be true and accurate at the date of publication. Neither the publisher nor the authors or the editors give a warranty, expressed or implied, with respect to the material contained herein or for any errors or omissions that may have been made. The publisher remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This Springer imprint is published by the registered company Springer Nature Switzerland AG
The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland
# Preface

This volume contains the proceedings of the 32nd IFIP International Conference on Testing Software and Systems (ICTSS 2020). IFIP-ICTSS has become a traditional event of the WG 6.1 of the International Federation for Information Processing (IFIP). The conference was supposed to be in Napoli, Italy, during December 9–11, 2020, but, due to the COVID-19 pandemic, it was held online, as a virtual conference.

ICTSS is a series of international conferences addressing conceptual, theoretical, and practical problems of testing software systems, including communication protocols, services, distributed platforms, middleware, embedded, cyber-physical systems, and security infrastructures. It is a forum for researchers, developers, testers, and users from industry to review, discuss, and learn about new approaches, concepts, theories, methodologies, tools, and experiences in the field of testing of software and systems.

IFIP-ICTSS 2020 received 43 submissions. Each paper was reviewed in a single-blind process by three reviewers on average and discussed by the Program Committee. After a careful selection process, the Program Committee accepted 17 regular papers and 4 short papers. The papers cover a large range of subjects such as test-case generation, testing in relation with artificial intelligence, proof and verification techniques, security, performance, as well as empirical studies. In particular, in the 32nd conference edition, a large space was given to security testing models and techniques.

IFIP-ICTSS 2020 also hosted an industrial event with the participation of big and small enterprises, discussing about their vision and practical experiences on software and security testing, with the aim to encourage interactions and exchanges between the scientific and industrial communities interested in testing.

We would like to thank the Steering Committee for their advice and support in the organization of the conference. Many thanks to the Program Committee members, as well as to the additional reviewers, for their careful reviews and participation in the discussions during the paper selection. The process of reviewing and selecting the papers was significantly simplified through the use of EasyChair. We would also like to thank IFIP for their continuous support of the conference series, as well as Springer for having published this volume.

We would like to thank the CERICT Organizing Committee, particularly Marco Guarino, Michele Salza, and Tiziana Cibelli for their support in the preparation of the conference, as well as in financial and organizational aspects. We kindly thank Silvio Stefanucci, the conference webmaster.

Finally, we are very grateful to the scientific sponsors of the conference: the University of Naples Federico II, the University of Campania Luigi Vanvitelli, and the University of Sannio. Their support strongly contributed to the success of this event.
On behalf of the IFIP-ICTSS organizers, we hope that you find the proceedings useful, interesting, and challenging.

December 2020

Valentina Casola

Alessandra De Benedictis

Massimiliano Rak
## Organization

### General Chairs

Valentina Casola University of Naples Federico II, Italy

Massimiliano Rak University of Campania Luigi Vanvitelli, Italy

### Program Committee Chair

Alessandra De Benedictis University of Naples Federico II, Italy

### Steering Committee

Inmaculada Medina Bulo University of Càdiz, Spain

Ana Cavalli Télécom SudParis, France

Christophe Gaston CEA List, France

Rob Hierons The University of Sheffield, UK

Nikolai Kosmatov CEA List, France

Pascale Le Gall CentraleSupélec, France

Francisco Palomo Lozano University of Càdiz, Spain

Mercedes Merayo Universidad Complutense de Madrid, Spain

Andreas Ulrich Siemens AG, Germany

Husnu Yenigun Sabanci University, Turkey

Nina Yektushenko Tomsk State University, Russia

### Program Committee

Rui Abreu INESC-ID/IST, University of Lisbon, Portugal

Bernhard K. Aichernig TU Graz, Austria

Antonia Bertolino ISTI-CNR, Italy

Valentina Casola University of Naples Federico II, Italy

Ana Rosa Cavalli Télécom SudParis, France

Xiao Chen Monash University, Australia

David Clark University College London, UK

Giovanni Cozzolino University of Naples Federico II, Italy

Alessandra De Benedictis University of Naples Federico II, Italy

Pedro Delgado-Pérez University of Càdiz, Spain

Sergio Di Martino University of Naples Federico II, Italy

Khaled El-Fakih American University of Sharjah, UAE

Ylies Falcone Université Grenoble Alpes, France

Anna Rita Fasolino University of Naples Federico II, Italy

Jun Gao University of Luxembourg, Luxembourg

Angelo Gargantini University of Bergamo, Italy
<table>
  <tr>
    <td>Christophe Gaston</td>
    <td>CEA, France</td>
  </tr>
  <tr>
    <td>Juergen Grossmann</td>
    <td>Fraunhofer, Germany</td>
  </tr>
  <tr>
    <td>Roland Groz</td>
    <td>Grenoble INP, LIG, France</td>
  </tr>
  <tr>
    <td>Rob Hierons</td>
    <td>The University of Sheffield, UK</td>
  </tr>
  <tr>
    <td>Teruo Higashino</td>
    <td>Osaka University, Japan</td>
  </tr>
  <tr>
    <td>Thierry Jéron</td>
    <td>Inria, France</td>
  </tr>
  <tr>
    <td>Ferhat Khendek</td>
    <td>Concordia University, Canada</td>
  </tr>
  <tr>
    <td>Pingfan Kong</td>
    <td>University of Luxembourg, Luxembourg</td>
  </tr>
  <tr>
    <td>Nikolai Kosmatov</td>
    <td>CEA List, France</td>
  </tr>
  <tr>
    <td>Moez Krichen</td>
    <td>ReDCAD Research Unit, Tunisia</td>
  </tr>
  <tr>
    <td>Natalia Kushik</td>
    <td>Télécom SudParis, France</td>
  </tr>
  <tr>
    <td>Pascale Le Gall</td>
    <td>CentraleSupélec, France</td>
  </tr>
  <tr>
    <td>Kui Liu</td>
    <td>Nanjing University of Aeronautics and Astronautics, China</td>
  </tr>
  <tr>
    <td>Luis Llana</td>
    <td>Universidad Complutense de Madrid, Spain</td>
  </tr>
  <tr>
    <td>Delphine Longuet</td>
    <td>Université Paris-Sud, LRI, France</td>
  </tr>
  <tr>
    <td>Jorge Lopez</td>
    <td>Airbus Defense and Space, France</td>
  </tr>
  <tr>
    <td>Radu Mateescu</td>
    <td>Inria, France</td>
  </tr>
  <tr>
    <td>Inmaculada Medina-Bulo</td>
    <td>University of Càdiz, Spain</td>
  </tr>
  <tr>
    <td>Mercedes Merayo</td>
    <td>Universidad Complutense de Madrid, Spain</td>
  </tr>
  <tr>
    <td>Roberto Nardone</td>
    <td>Mediterranean University of Reggio Calabria, Italy</td>
  </tr>
  <tr>
    <td>Roberto Natella</td>
    <td>University of Naples Federico II, Italy</td>
  </tr>
  <tr>
    <td>Manuel Núñez</td>
    <td>Universidad Complutense de Madrid, Spain</td>
  </tr>
  <tr>
    <td>Mike Papadakis</td>
    <td>University of Luxembourg, Luxembourg</td>
  </tr>
  <tr>
    <td>Antonio Pecchia</td>
    <td>University of Sannio, Italy</td>
  </tr>
  <tr>
    <td>Jan Peleska</td>
    <td>TZI, Universität Bremen, Germany</td>
  </tr>
  <tr>
    <td>Roberto Pietrantuono</td>
    <td>University of Naples Federico II, Italy</td>
  </tr>
  <tr>
    <td>Massimiliano Rak</td>
    <td>University of Campania Luigi Vanvitelli, Italy</td>
  </tr>
  <tr>
    <td>Antoine Rollet</td>
    <td>LaBRI, Bordeaux INP, CNRS, University of Bordeaux, France</td>
  </tr>
  <tr>
    <td>Stefano Russo</td>
    <td>University of Naples Federico II, Italy</td>
  </tr>
  <tr>
    <td>Sébastien Salva</td>
    <td>LIMOS, France</td>
  </tr>
  <tr>
    <td>Sergio Segura</td>
    <td>University of Seville, Spain</td>
  </tr>
  <tr>
    <td>Hasan Sozer</td>
    <td>Ozyegin University, Turkey</td>
  </tr>
  <tr>
    <td>Daniel Sundmark</td>
    <td>Mälardalen University, Sweden</td>
  </tr>
  <tr>
    <td>Kenji Suzuki</td>
    <td>Kennisbron Co., Ltd, Japan</td>
  </tr>
  <tr>
    <td>Masaki Suzuki</td>
    <td>KDDI Research, Inc., Japan</td>
  </tr>
  <tr>
    <td>Porfirio Tramontana</td>
    <td>University of Naples Federico II, Italy</td>
  </tr>
  <tr>
    <td>Andreas Ulrich</td>
    <td>Siemens AG, Germany</td>
  </tr>
  <tr>
    <td>Umberto Villano</td>
    <td>University of Sannio, Italy</td>
  </tr>
  <tr>
    <td>Burkhart Wolff</td>
    <td>Université Paris-Sud, France</td>
  </tr>
  <tr>
    <td>Franz Wotawa</td>
    <td>TU Graz, Austria</td>
  </tr>
  <tr>
    <td>Hüsnü Yenigün</td>
    <td>Sabancı University, Turkey</td>
  </tr>
  <tr>
    <td>Nina Yevtushenko</td>
    <td>Institute for System Programming, RAS, Russia</td>
  </tr>
  <tr>
    <td>Fatiha Zaidi</td>
    <td>Université Paris-Sud, France</td>
  </tr>
</table>
**Workshop Chair**

Roberto Nardone Mediterranean University of Reggio Calabria, Italy

**Publicity Chair**

Umberto Villano University of Sannio, Italy

**Additional Reviewers**

Nicola Amatucci
Christian Esposito
Massimo Ficco
Salah Ghamizi
Daniele Granata
Alessio Merlo

Francesco Moscato
Giovanni Salzillo
Luigi Libero Lucio Starace
Salvatore Venticinque
Vincenzo Norman Vitale
# Contents

## Model-Based Testing

Using Model Learning for the Generation of Mock Components. 3
Sébastien Salva and Elliott Blot

Interrogating Virtual Agents: In Quest of Security Vulnerabilities. 20
Josip Bozic and Franz Wotawa

Giving a Model-Based Testing Language a Formal Semantics
via Partial MAX-SAT. 35
Bernhard K. Aichernig and Christian Burghard

Learning Abstracted Non-deterministic Finite State Machines. 52
Andrea Pferscher and Bernhard K. Aichernig

## Security Testing

APPregator: A Large-Scale Platform for Mobile Security Analysis. 73
Luca Verderame, Davide Caputo, Andrea Romdhana, and Alessio Merlo

Vulploit: A Module for Semi-automatic Exploitation of Vulnerabilities. 89
Arcangelo Castiglione, Francesco Palmieri, Mariangela Petraglia,
and Raffaele Pizzolante

About the Robustness and Looseness of Yara Rules. 104
Gerardo Canfora, Mimmo Carapella, Andrea Del Vecchio,
Laura Nardi, Antonio Pirozzi, and Corrado Aaron Visaggio

Measurement-Based Analysis of a DoS Defense Module for an Open
Source Web Server. 121
Marta Catillo, Antonio Pecchia, and Umberto Villano

Trust Is in the Air: A New Adaptive Method to Evaluate Mobile
Wireless Networks. 135
Alexandra-Elena Mocanu (Mihaita), Bogdan-Costel Mocanu,
Christian Esposito, and Florin Pop

Enabling Next-Generation Cyber Ranges with Mobile
Security Components. 150
Enrico Russo, Luca Verderame, and Alessio Merlo
## Testing Methods and Applications

A Technique for Parallel GUI Testing of Android Applications Porfirio Tramontana, Nicola Amatucci, and Anna Rita Fasolino 169

Trigger Alarm: A Smart NFC Sniffer for High-Precision Measurements. Martin Erb, Christian Steger, Martin Troyer, and Josef Preishuber-Pflügl 186

Methods for Live Testing of Cloud Services. Oussama Jebbar, Ferhat Khendek, and Maria Toeroe 201

## Testing Methods and Automation

Automated Transition Coverage in Behavioural Conformance Testing Lina Marsso, Radu Mateescu, and Wendelin Serwe 219

An Executable Mechanised Formalisation of an Adaptive State

Counting Algorithm Robert Sachtleben 236

Automatic Fairness Testing of Machine Learning Models. Arnab Sharma and Heike Wehrheim 255

Inspecting Code Churns to Prioritize Test Cases Francesco Altiero, Anna Corazza, Sergio Di Martino, Adriano Peron, and Luigi Libero Lucio Starace 272

## Short Contributions

Using an SMT Solver for Checking the Completeness of FSM-Based Tests Evgenii Vinarskii, Andrey Laputenko, and Nina Yevtushenko 289

Hacking Goals: A Goal-Centric Attack Classification Framework Francesco Caturano, Gaetano Perrone, and Simon Pietro Romano 296

A Comparative Study on Combinatorial and Random Testing for Highly

Configurable Systems Hao Jin, Takashi Kitamura, Eun-Hye Choi, and Tatsuhiro Tsuchiya 302

Architecture Based on Keyword Driven Testing with Domain Specific

Language for a Testing System. Ricardo B. Pereira, Miguel A. Brito, and Ricardo J. Machado 310

Author Index 317