SESeLE and ITS EFFECTIVENESS: AN EMPIRICAL STUDY

In this research paper, the author have evaluated the SESeLE (Software Engineering Simulation Based e-Learning Environment) on the basis of subjective data gained from a controlled experiment that evaluated the effectiveness of SESeLE with the help of a standard software project model. This was done by providing a scenario-drive n interactive single-learner environment that can be accessed through the internet by using a standard web-browser through the SESeLE tool. The training module used in the study is composed of course material on project planning and control. The core element of the training module is a set of inter related project management (i.e. planning) models, represented by a simulation model that was created by using the System Dynamics (SD) simulation modeling method. Keyword - Simulation, pre-test, post-test, Behaviour, empirical patterns,project management issues, "simple" project dynamics, "complex" project dynamics, experimental group, control group. Based on the simulations, it is possible to demonstrate that catering to the software requirements volatility is an extremely effort consuming for the software development organizations and that investments in systems engineering, in order to stabilize requirements definition, will well pay off. For the model users, the results of the simulation experiments provide a twofold advantage. Firstly, a deeper understanding of the procedures for capturing and changing requirements grew up in the assessment team while discussing about real life and its representation through the model. Secondly, the quantitative evaluation of the present situation and of the effect of possible changes is convincing for the organization. The model results help a lot to broaden the view of the requirements process within software development and to start an improvement programme across all the roles and organizations participating in this process. Note, that all results produced by the simulation models are based on qualitatively formulated assumptions underlying the model structure. Without thorough review of the model structure by experts and without a calibration of the model parameters and model functions to empirical data, the model cannot be used for precise point estimates in the sense of a predictive model. However, for the model users, having such a simulation model at hand makes it quite easy to visualize the critical project behaviour and to discuss the assumptions about the cause-effect relationships that are supposed to be responsible for the generated behaviour. In order to examine the effectiveness of computer-base d training in the field of software project management using an SD simulation model implemented through the SESeLE tool, a controlled experiment applying a 'pre-training test post- training test' control group design was conducted. The learners who participated in the experiment were made to appear in two tests, one before the training session (pre-training test) on SESeLE and one after the training session (post-training test) on SESeLE. The effectiveness of the training was then evaluated by comparing scores from post-training test to pre-training test scores, and by comparing the scores between two categories of learners: (a) the learners in the experimental group, i.e. those who used the SDM, and (b) the learners in the control group, i.e. those who used a conventional project planning model instead of the SDM. The following dimensions were used to characterize "effectiveness" of the training session: