Cooperation Quality Assessment: Development and Implementation of the Cooperation Analytics (COESO D.5.1)
Creators: name: Boullier, Dominique
name: Pidoux, Jessica
Publisher: name: Zenodo
Year: 2021
Subjects: social sciences and humanities
SSH
citizen science
participatory research
cooperation analytics
cooperation
COESO Project

description: The Deliverable D5.1 WP5 - Cooperation Quality Assessment: Development and Implementation of the Cooperation Analytics is organized into five sections covering the conceptualisation and operationalisation of indicators to measure multiple cooperation practices.


After framing the scope and purpose of WP5 within COESO in section II, the deliverable presents first, in section III, a state of the art on the cooperation definition, the features that define more specifically cooperation, along with the methods of measurement in the literature resulting in a conceptual grid. The conceptual grid is relevant as it justifies the construction of indicators we define in the following sections.


Second, in section IV, the cooperation analytics’ monitoring grid is developed in detail. It represents the main conceptualisation stage of cooperation analytics. In this section we create a correspondence table between every feature retained and its level of analysis from the bibliography. In this section, we define every feature as it will be adopted in VERA’s cooperation analytics.


Third, section V represents the core of the cooperation analytics operationalisation. However, it is important to note that the operationalisation is still at a conceptual design phase, as the VERA platform is not developed yet. But this step constitutes an important translation of the concepts into criteria that can be quantified and presented visually to practitioners and social scientists. In this section, the monitoring grid includes an operationalisation of cooperation based on four levels of granular analysis:


● a typology of cooperation,
● the cooperation features that define four types of cooperation,
● the categorical values for each cooperation feature in link with every cooperation type,
● the indicator construction,
● the data and text corpora to be collected within VERA along with their analysis methods.


This section ends with the analysis of data visualization possibilities for the monitoring grid. Here we present the five main options retained. The indicators that will be presented to VERA users in the form of a monitoring grid are not a mere replication of the user activity tracked. Instead, the indicators will assess more broadly the cooperation practices in an aggregated way. The reason for this choice is that indicators, as a feedback, can directly affect the behavior of participants, to the point where they may try to conform to the scores and metrics, following what is called the “Goodheart effect” (a metrics that becomes the target of a behavior becomes a nasty metrics; i.e. used for autoreferential conformist purposes and not for reflexivity purposes anymore.)


Fourth, in section VI, the deliverable provides an overview of the five Pilots’ state of progress based on interviews we conducted and additional ones conducted by Net7. Here we present five main observations we made on the Pilots’ state of progress from an exploratory analysis. The section includes our main contribution and the challenges we are facing to develop cooperation analytics.


Finally, section VII concludes the document with the next steps for reviewing, implementing and testing the cooperation analytics here defined. The final section provides a view on where we are heading: to a close and experimental collaboration phase with Net7 and the Pilots that contributes to the development of cooperation analytics along with VERA’s core functionalities.