DOI: 10.6084/m9.figshare.27224493.v1
title: <b>Smart Contract Vulnerabilities, Tools, and Benchmarks: An Updated Systematic Literature Review</b>

description: <b>Smart Contract Vulnerabilities, Tools, and Benchmarks: An Updated Systematic Literature Review</b>This repository contains all the data, analyses, and scripts used in the study on smart contract vulnerabilities, detection tools, and benchmark evaluation.It is organized into multiple folders, each corresponding to a specific stage of the research workflow.---<b>## 📁 Root Files</b><br><b>### Query_results.xlsx</b>This file includes all papers extracted using the research strings.For each paper, the inclusion and exclusion criteria and the following data quality metrics are reported:- <b>Contextual Data Quality (CDQ)</b> – evaluates the contextual relevance of the paper.- <b>Intrinsic Data Quality (IDQ)</b> – assesses the intrinsic validity and completeness of the study.- <b>Final Data Quality (FDQ)</b> – represents the overall evaluation used to determine whether the paper is included in the final dataset.---<b>### Data_analysis.xlsx</b>This file includes only the papers that <b>passed the quality evaluation</b> (i.e., those with satisfactory FDQ values).All information was extracted from this set of papers using dedicated <b>data forms</b> designed to collect standardized information for subsequent analysis.---<b>## 📂 Results Folder</b><br>The <b>results</b> folder contains four separate files, one for each <b>Research Question (RQ)</b> defined in the study.Each file reports the detailed outcomes and synthesized data related to its respective RQ.---<b>## 📂 Taxonomy Folder</b><br>The <b>Taxonomy</b> folder contains all materials related to the construction and validation of the vulnerability taxonomy.<br><b>### Synonyms_to_Representative.xlsx</b>- Shows how representative vulnerabilities were selected for each <b>cluster of synonymous vulnerabilities</b>.- Each cluster groups semantically equivalent or overlapping vulnerability labels identified across the analyzed studies.<br><b>### Validation</b>This subfolder contains the results of the <b>four expert interviews</b> conducted to validate the taxonomy.Each interview provides feedback and adjustments that contributed to refining the taxonomy structure and naming.<br><b>### TaxonomyValidation_main.xlsx</b>- Summarizes the results of the expert validation process.- Presents a comparison between the <b>taxonomy before and after validation</b>.- Reports the <b>Cohen’s Kappa</b> coefficient achieved by the experts, indicating the level of agreement during the validation phase.---<b>## 📂 Scripts Folder</b>The <b>Scripts</b> folder includes all Python scripts used to process and analyze the collected data.<b>### keywords_sensitivity_analysis.py</b>- Evaluates the <b>sensitivity of the research strings</b> against emerging keywords.- Helps assess whether additional or alternative keywords could improve recall in future literature searches.<b>### tool_x_bench_coverage.py</b>- Analyzes the <b>coverage of detection tools</b> and <b>benchmarks</b>, correlating them to measure how effectively existing tools are tested across different benchmark datasets.<br><b>Further information</b>- For further information, contact the authors of the paper.