D.8.1: Evaluation methodology
Creators: name: Allmer, Gottfried
name: Althoff, Isabel
name: Amendola, Danilo
name: Bellini, Alberto
name: Blakeman, Paul
name: Bonetto, Edoardo
name: Brevi, Daniele
name: Buchholz, Michael
name: Haetty, Birger
name: Hegyi, Robert Mark
name: Lepretre, Kevin
name: Massot, Guillemette
name: Parsons, Clive
name: Petrou, Anastasia
name: Ring, Patrick
name: Rizzi, Gianluca
name: Schulz, Steffen
name: Spada, Maria Rita
name: Strohbeck, Jan
name: Vogl, Friedrich
name: Wimmer, Markus
Publisher: name: Zenodo
Year: 2020

description: The aim of the ICT4CART project is to design, implement and test a versatile ICT infrastructure in real-life conditions, which will enable the transition towards higher levels of automation. It focuses on four high-value use cases: Smart Parking &amp; IoT services, dynamic adaptation of vehicle automation level based on infrastructure information, intersection crossing (urban) &amp; lane merging (highway), and cross-border Interoperability. ICT4CART use cases have been carefully selected based on specific criteria, which are: i) alignment with EU policy and relevant forums and initiatives, ii) significant impact on connected automation, iii) the ability to generalise on the results (applicable in other scenarios and environments), and iv) interest to the consortium members and relevance to their industrial roadmaps. Moreover, these use cases are serving one of the main targets of the project, which is to show that the proposed and implemented ICT infrastructure architecture is flexible, adaptable and can serve the needs of various automated driving use cases (safety, comfort, etc.) with different requirements, across test sites with different capabilities. The ICT4CART use cases can be global or 7 local, can be associated with network slices or not, can use Edge Clouds/Computing or not, can use different radio technologies and can be used everywhere (roaming aspect). They also consider mechanisms for cyber-security, authentication, integrity and privacy. For this purpose, four test sites are involved in ICT4CART, namely in Austria, in Germany, in Italy and a cross-border site at the Austrian-Italian borders. The main objective of WP8 is to evaluate the ICT4CART architecture through the proposed scenarios defined for each test site. Since ICT4CART deals with many different components, multiple use cases and novel architectural solutions, its actual evaluation becomes pivotal and inartistically multifaceted. WP8 will evaluate and validate each logical component of the proposed architecture (D3.1-D3.4) and its potential impact (impact assessment), validate the proposes use cases (D2.1) and finally evaluate the overall role of the infrastructure in enabling the transition towards road transport automation. First, the introduction in Section 1 describes the aims of ICT4CART, i.e., the design and deployment of the ICT4CART technologies on the test sites covering all use cases. Section 2, presents the KPIs and metrics framework to be used in ICT4CART, whereas Section 3 and Section 4 present the set of the Technical KPIs and Impact assessment metrics accordingly. Section 5, presents the technical evaluation methodology to be employed in Task 8.2 “Technical Performance Evaluation” of the project, whereas Section 6 present the generalization methodology to be employed and the simulation schemes that will allow the consortium to test the ICT4CART architecture under real network and road traffic situations for a specific demanding scenario. Section 7, is devoted to the impact assessment evaluation methodology that will be employed in Task 8.3 “Impact Assessment” of the project, whereas Section 8 presents the cost analysis and market sustainability methodology to be employed in Task 8.4 “Cost Analysis and Market Sustainability” of the project. Finally, Section 9 concludes the report.