5g-routes: D1.7 Testing framework for the technological and business validation and benchmarking of the results
Creators: name: Scholliers, Johan
Publisher: name: Zenodo
Year: 2022

description: The 5G-ROUTES project will conduct advanced field trials of most representative and innovative CCAM applications seamlessly functioning across a designated 5G cross-border corridor (Riga-Valga-Tallinn-Helsinki) spanning across 3 EU member states borders (Latvia-Estonia-Finland) in order to validate the latest 5G features and 3GPP specifications under realistic conditions, so as to accelerate the widespread deployment of 5G E2E interoperable CCAM ecosystems and services in digitized motorways, railways and shipways throughout Europe. The scope of this deliverable is to define the methodology and the toolset for both the technological performance and business validation of the use cases. This deliverable gives the state of the test framework at the current state of the project (end of month 3 of implementation). The use cases and the selection of the trial locations are not yet finalized. An updated version of this deliverable will be provided in month 10, and will include more details, including the common logging format as well as the procedures for collecting data. The final version of this report (deliverable D1.8, due in month 24) will consolidate insights from the first phase of the large scale trials execution, providing a reference framework for CCAM services validation. The report gives an overview of the testing framework. The testing framework builds on the expertise and the results of other projects, such as 5G-SOLUTIONS, 5G-TOURS, TRUSTS, FESTA and 5G-MOBIX. 5G-ROUTES. 5GROUTES uses the iterative Plan-Do-Check-Act approach, including 3 cycles for the technical validation, with 2 local trial cycles for 3GPP R16 and R17 and one wider large scale trial cycle covering the whole corridor. The performance KPIs of each use case will be evaluated during the different testing cycles, to illustrate how 5G capabilities and 5G-Routes technical enablers are leveraged and how they impact application performance. Testing of CCAM automated driving use cases puts specific requirements to the testing environment. The local trials will be performed near the border crossing between Estonia-Latvia and on the ferry between Tallinn and Helsinki. In addition, tests will be performed at the Bikernieki racing track in Riga, where a virtual border involving Estonian and Latvian MNOs will be set up. The business validation processis challenged with engaging and examining the field Trials with a commercial and business lens in order to identify those solutions that are most likely to become commercially viable and can deliver the most immediate quantifiable value to the stakeholders involved in each Use Case. The business validation process in 5G-ROUTES is based on the approach used in the 5G-SOLUTIONS project. 5G-ROUTES uses a methodology based on the Lean Start-up methodology, in 4 phases: customer validation, solutions alignment, business model selection and growth trajectory. The Business impact assessment of 5G-ROUTES will be based on the analysis of the business models and value propositions through the application of the - adapted to the project needs – Multi-Actor Multi-Criteria Analysis (MAMCA) methodology that will result to a broad screening of the business opportunities and their ranking, followed by a Cost-Benefit Analysis (CBA) that will evaluate in-depth the present value of the benefit streams for the selected business cases Further the report describes the data collection. Starting from an initial list of the KPIs, the components where data is collected are defined. For the technical validation, data will be collected from the network, vehicles and from the other equipment used in the project. End-users will be involved for some use cases for user acceptance evaluation. A uniform format for data collection will be defined. The collected data will be uploaded to the Tenant Web, where the KPIs will be visualised. The different methods and tools for collecting information from endusers are described. Core to this deliverable is the structure of the test plan, which will be developed for all use cases prior to starting the evaluation. Last, D1.7 describes how the different use cases plan to perform testing and provides the conclusions to be considered for the next steps of the project implementation.