DOI: 10.5281/zenodo.15133503
title: Deepening our Understanding on the use of Models and Code in Game Software Engineering: A Controlled Experiment in Unreal Engine: Replication Package

description: README — Artifact Package for MDD vs. CCD in Unreal Engine Experiment

🟢 This replication package corresponds to the paper accepted at the MODELS 2025 conference:

“Comparing Code-Centric and Model-Driven Development in Game Software Engineering: An Empirical Study in Unreal Engine”.

The experiment compares Model-Driven Development (MDD) and Code-Centric Development (CCD) in the context of Unreal Engine. The artifact has been prepared following the guidelines for the Reusable level of the Artifact Evaluation track.

The package is organized into three main subfolders:

Folder Structure

01_EXPERIMENT





101_CdE_ApproveReport: PDF file of the favorable report from the ethics and scientific committee approving the execution of the experiment.




102_Forms&Exercises: Task sheets for each group and the Unreal project with exercises to solve.




103_SupportMaterial: Support material that participants could consult while performing the experiment tasks.




104_SessionMaterial: Instructor materials used during the session, including task explanation videos.




105_CorrectionMaterial: Solutions to the tasks and the correction rubric.



02_RESULTS





201_DATASET: Data files (in .sav and .xlsx) containing all variables and factors measured.




202_BOXPLOTS-HISTOGRAMS: Boxplot and histogram visualizations for all variables (in .spv and .pdfformats).




203_DATASET_LMM: Dataset with residuals from LMM executions (.sav and .xls formats).




202_DEMOGRAPHIC: Demographic results in Excel format.




203_DESCRIPTIVES: Main descriptive statistics and normality tests (.spv, .pdf).




204_LMM: Type III fixed effects tests with unstructured repeated covariance matrices for all variables (.spv, .pdf).




204_LMM_OnlyDEV: Same as above but excluding artist profiles.




205_LMM_model selection: Details of statistical models used and model comparisons.




206_DESCRIPTIVES_COHEN: Effect size computations for each factor (.exe format).




207_DEMOGRAPHIC: Full demographic information.




208_Focus_Group_and_Demographic_Report: Full data from focus group sessions and participant demographics.



03_PAPER

This file contains the accepted version of the paper: “Comparing Code-Centric and Model-Driven Development in Game Software Engineering: An Empirical Study in Unreal Engine”, to appear in the proceedings of the ACM/IEEE 2025 International Conference on Model-Driven Engineering Languages and Systems (MODELS 2025).

HARDWARE REQUIREMENTS

To properly execute and interact with the Unreal Engine project included in this artifact, the following minimum hardware requirements are recommended:





Operating System: Windows 10 or higher (64-bit)




Processor: Intel Core i7 (8th generation or newer) or AMD Ryzen 7




RAM: 16 GB minimum (32 GB recommended)




GPU: NVIDIA GTX 1060 or AMD equivalent (RTX 3060 or higher recommended)




Storage: SSD with at least 50 GB of free spac



INSTALLATION GUIDE

This guide describes the steps to install and configure the required software to run the Unreal Engine experiment (comparing C++ vs. Blueprints).

1. Requirements

Ensure you have the following software downloaded:





Epic Games Launcher https://store.epicgames.com/es-ES/download




Visual Studio 2022 Community Edition https://visualstudio.microsoft.com/vs/community/




Visual Studio Build Tools 17.6 https://aka.ms/vs/17/release.ltsc.17.6/vs_buildtools.exe




Fab Visual Studio Integration Tool https://www.fab.com/listings/8a639215-7f85-4cc7-b155-fa2137326209



2. Installation Steps

2.1 Install Visual Studio 2022 Community





Run the installer.




Select and install the following workloads:





.NET Desktop Development




C++ Desktop Development




WinUI Application Development




C++ Game Development






Restart the computer if required.



2.2 Install Build Tools 17.6





Run the build tools installer.




Select:





.NET Desktop Development




C++ Desktop Development




Universal Windows Platform Compiler Tools






Complete the installation.



2.3 Install Unreal Engine





Open the Epic Games Launcher and log in.




Navigate to Unreal Engine > Library.




Install Unreal Engine version 5.3.2.



2.4 Install Fab Visual Studio Integration Tool





Add the plugin from the Marketplace link to your library.




Open the Epic Games Launcher.




Go to Unreal Engine > Library > Plugins (Fabs section).




Assign the plugin to Unreal Engine 5.3.2.



RUNNING THE EXPERIMENT PROJECT

To run the Unreal Engine project:





Decompress the Experiment_Unreal.zip file located in the 102_Forms&Exercises folder.




Open the project by double-clicking the Experiment_Unreal.uproject file.




Unreal Engine 5.3.2 will load the project. Ensure the Fab plugin is enabled if prompted.