DOI: 10.5281/zenodo.18813482
title: Replication Package for "Alone or in Combination? A Practitioner's Perspective on the Use of Generative AI for Static Code Quality Analysis"

description: We provide in the replication packages the following data:



The raw questionnaire dataset (all survey responses in a single spreadsheet).

The coded datasets (codebooks) for the open-ended questions, including:



Open codes and axial codes were produced by two independent coders (Coder A and Coder B).

A field indicating whether coders agreed on the axial-code set for each response.

Example excerpts and distributions to support transparency.



A mapping of respondent roles to ISO/IEC/IEEE terminology for role normalization.


No scripts are included. Analyses can be reproduced with spreadsheet tools (Excel, LibreOffice, Google Sheets) or by importing the spreadsheets into R/Python/JMP.

Package structure

.├─ README.md├─ LICENSE├─ RAW Data/ │ └─ RawQustionnaire.xlsx└─ Coding/├─ Q12.xlsx├─ Q19.xlsx├─ Q24.xlsx├─ Q26.xlsx├─ Q35.xlsx├─ Q36.xlsx├─ Q4-ISO_MAPPING.xlsx└─ Q4-ISO_MAPPING_Counts.xlsx

Data files

RAW Data/RawQustionnaire.xlsx

Sheet: RawQustionnaire



Each row corresponds to one respondent.

RID is the respondent identifier used across all files in this package.

Columns include demographics and experience questions, Likert-scale items, and open-ended answers.


Notes:



Some columns contain free-text responses. Please treat them as qualitative data.

The dataset file name uses the original spelling RawQustionnaire.xlsx as stored in the archive.


Coding/Qxx.xlsx (open-ended question Q12, Q19, Q24, Q26, Q35, Q36)

Sheets:



Coded_Data: response-level coding by two coders.

Detection_Distribution: distribution of the related closed question (for context).

Axial_Distribution: counts of axial codes.

Axial_Examples: example excerpts per axial code.

Code_Descriptions: definitions and explanations of the codes that emerged during the qualitative coding process.

Summary: summary table(s) for reporting.


Coded_Data columns:



ID: respondent identifier (matches RID in the raw dataset).

OriginalAnswer: original open-ended response text.

CoderA_OpenCodes, CoderA_Axial, CoderA_PrimaryAxial

CoderB_OpenCodes, CoderB_Axial, CoderB_PrimaryAxial

Agreement_Axial_Set: indicates agreement on the axial-code set.


Coding/Q4-ISO_MAPPING.xlsx

Sheet: Q4-ISO_MAPPING

Maps the free-text role field (Q4) to a normalized role label and to ISO/IEC/IEEE terminology:



RID: respondent identifier.

Q4. Occupation and role in the organization?: raw role text.

Q4 Coded As: normalized role label.

ISO Concept: ISO concept identifier/term used for normalization.

ISO Standard: referenced ISO/IEC/IEEE standard(s).


How to reproduce the qualitative results



Open RAW Data/RawQustionnaire.xlsx and locate the open-ended question columns (e.g., Q12, Q19, Q24, Q26, Q35, Q36).

For each open-ended question, open the corresponding Coding/Q*.xlsx file and use Coded_Data to:



Trace each coded row back to the original response.

Recompute frequency counts for open codes and axial codes (pivot tables work well).

Compare Coder A vs Coder B labels, and use Agreement_Axial_Set to quantify alignment.



Use Axial_Distribution and Summary sheets to validate the recomputed counts.

Use Axial_Examples to support reporting with representative excerpts.


Data ethics and privacy



The package contains respondent-level answers. Please avoid attempts to re-identify participants.

When sharing derived artifacts (tables, quotes), follow the ethics guidance and anonymization approaches and techniques relevant.


License

The data in this replication package is shared under the Creative Commons Attribution 4.0 International (CC BY 4.0) license.

You are free to share and adapt the material for any purpose, provided that appropriate credit (citation to the VoR paper) is given to the original authors and the source is properly cited.

Contact

For questions or issues, please contact the corresponding.