Public procurement notice: Contract Notice
Published: 2019-07-09
Buyer: Energinet Forretningsservice A/S
Country: DK
Contract type: Services
Procedure: Negotiated procedure
CPV classification: 72000000 | 72246000 | 72254000: Software testing | 72254100: Systems testing services
Estimated value:  DKK
Submission deadline: 2019-08-20
Award criteria: The most economic tender

Technical requirements: Υπηρεσίες τεχνολογίας των πληροφοριών: παροχή συμβουλών, ανάπτυξη λογισμικού, Διαδίκτυο και υποστήριξη
Agreement Covering Software Quality Assurance Including Software end-2-end Capabilities, Code Inspection and Data Cleansing
This contract will be concluded with Nordic RSC. Nordic RSC (Regional Security Coordinator) is as a joint office owned by Energinet, Fingrid, Svenska Kraftnät and Statnett with the purpose of delivering operational coordination in the Nordic electricity system. Nordic RSC has concluded a contract with GRID Solutions DENMARK, FILIAL AF Grid Solutions SAS, FRANKRIG, Strevelinsvej 8, Erritsø, 7000 Fredericia, Company Registration Number 27550835 on development of an infrastructure critical application. In this regard Nordic RSC needs an agreement covering software quality assurance including software end-2-end capabilities and code inspection on behalf of the Nordic Regional Security Coordinator and data cleansing. The Nordic RSC request a partner with software assessing capabilities in relation to infrastructure critical applications, and with the ability to both provide professional consulting and/or assist with skills to support both Nordic RSC as well as the Supplier of the application under the development. The partner shall be able to provide documentation for the ability to handle both the assessor role, as well as support with strong skills in the development/test process with this not being a conflict of interest. Nordic RSC needs among others the partner to assess the software requirement specification, software architecture specification, supplier’s software factory setup, the application code, the requirement traceability matrix, verification and validation.
Besides support to customers project manager and ensuring that the customers project team focus on the level of quality required that all project quality related issues are handled proactive and sufficiently the supplier must on request for the customer deliver the following services:
Nordic RSC have divided the total software delivery in 3 Major Releases (MR). In each MR user stories are developed to capture the scope of the release. These are developed by Nordic RSC and the application supplier in cooperation. Nordic RSC would like the quality assurance (QA) Partner to assess these user stories for them to be of a high quality before the development starts, evaluate whether they also cover the requirements from the contract, evaluate whether they are testable and provide improvement suggestions which improves the quality of the user stories.
Business rules of Nordic RSC are described in high-level in European legislation and interpret and adjusted to fit into the Nordic model. The description of the business rules shall be of a high quality for the supplier to understand the development requirements. Further the descriptions shall be described in detail for the application supplier developers to understand the development task. Nordic RSC would like the QA Partner to evaluate these descriptions and ensure that the application supplier developers have a chance to develop what is described or raise a warning to Nordic RSC and the application supplier for areas which are not described enough.
Both the user stories and the business rules need to be testable. Nordic RSC would like the QA Partner to assist Nordic RSC and the application suppliers test managers with reviewing the test cases developed for the purpose and propose improvement suggestions. Nordic RSC would like the QA Partner to develop test cases if this is required or Nordic RSC and the application supplier for some reason cannot capture them all.
The architecture of the software application is described in the SAS. The application developed will be deployed on th Nordic RSC infrastructure, which is a Cloud Azure Stack on premises. The architecture of the solution should be strong to ensure easy maintenance, scalable to ensure more users and more calculations can be included later, high performance to ensure a user friendly application in operation and with a clear and intuitive GUI.
Nordic RSC would like the QA Partner to evaluate this SAS and provided improvement suggestions if needed.
As part of the tender phase of the application Nordic RSC developed a requirement specification. The application supplier has been asked to ensure traceability from the requirements in the contract to the user stories and business rules described in the SRS and to the architecture described in the SAS. Further Nordic RSC has asked the application Supplier to perform V&V and ensure this is documented in a way, that it is easy for the customer to follow this process. Nordic RSC would like the QA Partner to review this process handled by the application supplier and ensure the process are performed correct by the application supplier. In the case that improvement is needed the QA Partner will raise a warning and describe the suggestions for Nordic RSC.
Nordic RSC and the application supplier have initiated a trustworthy partnership which is expected to last for many years. As part of this cooperation both Nordic RSC and the application supplier has a mutual interest in the development of this application is done the best way possible. The application Supplier has launched a ‘Brilliant Software Factory’ concept trying to move the internal software development into the future, with faster and more accurate deliveries going forward. Nordic RSC would like the QA Partner to review this process in relation to the development of the application and assist with improvement suggestions for the application supplier to implement.
Nordic RSC is undertaken by strong security rules and obligations. This both in terms of the people working at the Nordic RSC premises, as well as the tools deployed in the Nordic RSC premises.
Nordic RSC are looking for a QA Partner who can perform code inspection in terms of code review, code walkthrough, code-based testing and more. The QA Partner shall be able to perform the code inspection and document this structurally in an inspection report that lists all the findings for Nordic RSC and the application supplier to evaluate this together and implement the suggestions provided by the QA Partner.
6) Provide skills to evaluate or perform various of software tests including integration tests with relevant systems or infrastructure environment:
Nordic RSC would like the QA Partner to be skilled at software testing. This include among others being able to describe the tests needed, review the tests being performed and perform the test if needed.

Eligibility requirements: The applicant must, in the application to participate, confirm the economic ability with information from the latest annual report regarding the following economic indicator: 1) Equity (total equity incl. share capital, reserves, revaluation, retained earning, etc.). If the applicant is relying on the capacities of one or more other entities (e.g. a parent or sister company or a subcontractor) or the applicant is a group of economic operators (e.g. a consortium) the information must also be given from each of these entities. It is the sole responsibility of the applicant to secure that the minimum level(s) of standards required are reached when the applicant is relying on the capacity of other entities or when the applicant is a group of economic operators (e.g. a consortium). The applicant can download and fill out the template ‘Template Solemn Declaration’ on https://eu.eu-supply.com/ctm/supplier/publictenders?B=ENERGINET to documenting Equity (total equity incl. share capital, reserves, revaluation, retained earning, etc.). The Contracting Authority reserves the right to request the applicant to supplement, specify or complete the information submitted.
Equity from the latest annual report must be at least positive.
1) The applicant must in the application to participate include the up to 5 most comparable and relevant references undertaken and completed in the past three (3) years as part of the application. Undertaken in the past three (3) years implies that the reference must not have been completed prior to the date reached when counting 3 years backwards from the submission date for pre-qualification. References older than this will not be taken into consideration. References which have not yet been fully completed cannot be included as part of the application. The references should include: — a specific description of the work performed for each reference, including as many as possible of the following services: —— quality assurance on infrastructure critical applications, —— review of design of software applications, both in terms of functionalities as well as the non-functional requirement and architectural requirement, —— perform and/or monitor verification and validation processes for large application development projects, —— code inspection/code review and deliver the needed inspection reports, —— assessment of software factory processes and propose of improvements, —— perform test and or review tests being performed on infrastructure critical applications, —— performing data cleansing for large critical infrastructure clients, — contract value (if possible), — contact information for the entity in question (including contact person), — date of initiation and final delivery (day, month, year). Any ambiguities and/or incomprehensibilities concerning the above information may have a negative effect on the selection of candidates. If the applicant is relying on the references of one or more other entities (e.g. a parent or sister company or a subcontractor) or the applicant is a group of economic operators (e.g. a consortium) the information in Section III.2.1) and Section III.2.2) must also be given from each of these entities. The number of references should not surpass a maximum of the 5 most comparable and relevant references. If the applicant is relying on the capacity of one or more other entities (e.g. a parent or sister company or a subcontractor) or the applicant is a group of economic operators (e.g. a consortium) the maximum number of references to be submitted must still be respected and cannot exceed 5 when combined. If more than 5 references are included, the Contracting Authority will only consider the 5 most recent references determined by date of final delivery (in this case not yet finished references will not be included). Each reference must not be larger than 2 A4 pages. The applicant can download and fill out the template ‘Template — Technical and Professional Ability’ on https://eu.eu-supply.com/ctm/supplier/publictenders?B=ENERGINET to submit references. 2) The applicant must in the application to participate include documentation of maturity level for development (all processes). The applicant can download and fill out the template ‘Template — Technical and Professional Ability’ on https://eu.eu-supply.com/ctm/supplier/publictenders?B=ENERGINET to state which documentation of maturity level for development (all processes) that has been submitted. The Contracting Authority reserves the right to request the applicant to supplement, specify or complete the information submitted. Concerning 1: at least 3 references must be submitted. Concerning 2: CMMI certificate ‘or equivalent’ documenting maturity levels for development (all processes) on minimum CMMI level 4 ‘or equivalent’.
1) The applicant must in the application to participate include the up to 5 most comparable and relevant references undertaken and completed in the past three (3) years as part of the application. Undertaken in the past three (3) years implies that the reference must not have been completed prior to the date reached when counting 3 years backwards from the submission date for pre-qualification. References older than this will not be taken into consideration. References which have not yet been fully completed cannot be included as part of the application. The references should include: — a specific description of the work performed for each reference, including as many as possible of the following services: —— quality assurance on infrastructure critical applications, —— review of design of software applications, both in terms of functionalities as well as the non-functional requirement and architectural requirement, —— perform and/or monitor verification and validation processes for large application development projects, —— code inspection/code review and deliver the needed inspection reports, —— assessment of software factory processes and propose of improvements, —— perform test and or review tests being performed on infrastructure critical applications, —— performing data cleansing for large critical infrastructure clients, — contract value (if possible), — contact information for the entity in question (including contact person), — date of initiation and final delivery (day, month, year). Any ambiguities and/or incomprehensibilities concerning the above information may have a negative effect on the selection of candidates. If the applicant is relying on the references of one or more other entities (e.g. a parent or sister company or a subcontractor) or the applicant is a group of economic operators (e.g. a consortium) the information in Section III.2.1) and Section III.2.2) must also be given from each of these entities. The number of references should not surpass a maximum of the 5 most comparable and relevant references. If the applicant is relying on the capacity of one or more other entities (e.g. a parent or sister company or a subcontractor) or the applicant is a group of economic operators (e.g. a consortium) the maximum number of references to be submitted must still be respected and cannot exceed 5 when combined. If more than 5 references are included, the Contracting Authority will only consider the 5 most recent references determined by date of final delivery (in this case not yet finished references will not be included). Each reference must not be larger than 2 A4 pages. The applicant can download and fill out the template ‘Template — Technical and Professional Ability’ on https://eu.eu-supply.com/ctm/supplier/publictenders?B=ENERGINET to submit references. 2) The applicant must in the application to participate include documentation of maturity level for development (all processes). The applicant can download and fill out the template ‘Template — Technical and Professional Ability’ on https://eu.eu-supply.com/ctm/supplier/publictenders?B=ENERGINET to state which documentation of maturity level for development (all processes) that has been submitted. The Contracting Authority reserves the right to request the applicant to supplement, specify or complete the information submitted.
Concerning 1: at least 3 references must be submitted. Concerning 2: CMMI certificate ‘or equivalent’ documenting maturity levels for development (all processes) on minimum CMMI level 4 ‘or equivalent’.