DOI: 10.5281/zenodo.7347432
title: A crowdsourced dataset of aerial images with annotated solar photovoltaic arrays and installation metadata

description: <strong>Summary</strong> Photovoltaic (PV) energy generation plays a crucial role in the energy transition. Small-scale PV installations are deployed at an unprecedented pace, and their integration into the grid can be challenging since stakeholders often lack quality data about these installations. Overhead imagery is increasingly used to improve the knowledge of distributed PV installations with machine learning models capable of automatically mapping these installations. However, these models cannot be easily transferred from one region or data source to another due to differences in image acquisition. To address this issue known as domain shift and foster the development of PV array mapping pipelines, we propose a dataset containing aerial images, annotations, and segmentation masks. We provide installation metadata for more than 28,000 installations. We provide ground truth segmentation masks for 13,000 installations, including 7,000 with annotations for two different image providers. Finally, we provide ground truth annotations and associated installation metadata for more than 8,000 installations. Dataset applications include end-to-end PV registry construction, robust PV installations mapping, and analysis of crowdsourced datasets. This dataset contains the complete records associated with the article "A crowdsourced dataset of aerial images of solar panels, their segmentation masks, and characteristics", currently under review. The preprint is accessible at this link: https://arxiv.org/abs/2209.03726. These complete records consist of: The complete training dataset containing RGB overhead imagery, segmentation masks and metadata of PV installations (folder <strong>bdappv</strong>), The raw crowdsourcing data, and the postprocessed data for replication and validation (folder <strong>data</strong>). <strong>Data records</strong> Folders are organized as follows: <strong>bdappv/</strong> Root data folder <strong>google / ign:</strong> One folder for each campaign <strong>img/</strong>: Folder containing all the images presented to the users. This folder contains 28807 images for Google and 17325 images for IGN. <strong>mask/</strong>: Folder containing all segmentations masks generated from the polygon annotations of the users. This folder contains 13303 masks for Google and 7686 masks for IGN. <em>metadata.csv</em> The <code>.csv</code> file with the installations' metadata. <strong>data/ </strong>Root data folder <strong>raw/</strong> Folder containing the raw crowdsourcing data and raw metadata; <em>input-google.json</em>: <code>.json </code>input data data containing all information on images and raw annotators’ contributions for both phases (clicks and polygons) during the first annotation campaign; <em>input-ign.json</em>:<em> </em><code>.json </code>input data containing all information on images and raw annotators’ contributions for both phases (clicks and polygons) during the second annotation campaign; <em>raw-metadata.json</em>: <code>.json </code>output containing the PV systems’ metadata extracted from the BDPV database before filtering. It can be used to replicate the association between the installations and the segmentation masks, as done in the notebook metadata. <strong>replication/</strong> Folder containing the compiled data used to generate the segmentation masks; <strong>campaign-google/campaign-ign</strong>: One folder for each campaign <em>click-analysis.json</em>: <code>.json </code>output on the click analysis, compiling raw input into a few best-guess locations for the PV arrays. This dataset enables the replication of our annotations, <em>polygon-analysis.json</em>: <code>.json </code>output of polygon analysis, compiling raw input into a best-guess polygon for the PV arrays. <strong>validation/</strong> Folder containing the compiled data used for technical validation. <strong>campaign-google/campaign-ign</strong>: One folder for each campaign <em>click-analysis-thres=1.0.json</em>: <code>.json </code>output of the click analysis with a lowered threshold to analyze the effect of the threshold on image classification, as done in the notebook annotation; <em>polygon-analysis-thres=1.0.json</em>: <code>.json </code>output of polygon analysis, with a lowered threshold to analyze the effect of the threshold on polygon annotation, as done in the notebook annotations. <em>metadata.csv</em>: the <code>.csv </code>file of filtered installations' metadata. <strong>License</strong> We extracted the thumbnails contained in the <strong>google/img/</strong> folder using Google Earth Engine API and we generated the thumbnails contained in the <strong>ign/img</strong><strong>/</strong> folder from high resolution tiles downloaded from the online IGN portal accessible here: https://geoservices.ign.fr/bdortho. Images provided by Google are subjet to Google's terms and conditions. Images provided by the IGN are subject to an open license 2.0. Access the terms and conditions of Google images at this URL: https://www.google.com/intl/en/help/legalnotices_maps/ Access the terms and conditions of IGN images at this URL: https://www.etalab.gouv.fr/wp-content/uploads/2018/11/open-licence.pdf