# Using Gamification Mechanisms and Digital Games in Structured and Unstructured Learning Contexts

Ioana Andreea Stanescu, Antoniu Stefan, Jannicke Madeleine Baalsrud Hauge

► To cite this version:

Ioana Andreea Stanescu, Antoniu Stefan, Jannicke Madeleine Baalsrud Hauge. Using Gamification Mechanisms and Digital Games in Structured and Unstructured Learning Contexts. 15th International Conference on Entertainment Computing (ICEC), Sep 2016, Wien, Austria. pp.3-14, 10.1007/978-3-319-46100-7_1. hal-01640288

HAL Id: hal-01640288

https://inria.hal.science/hal-01640288

Submitted on 20 Nov 2017

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# Using gamification mechanisms and digital games in structured and unstructured learning contexts

Ioana Andreea Stanescu¹, Antoniu Stefan¹, Jannicke Madeleine Baalsrud Hauge²,³,⁴,

¹Advanced Technology Systems

Str. Tineretului Nr 1., 130029, Targoviste, Romania

{ioana.stanescu, antoniu.stefan}@ats.com.ro

²BIBA - Bremer Institut für Produktion und Logistik GmbH,

Hochschulring 20, D-28359 Bremen, Germany

baa@biba.uni-bremen.de

³University of Bremen

Bibliothek Straße 1, 28359 Bremen, Germany

jmbh@uni-bremen.de

⁴Royal Institute of Technology

Alfreds Nobels Alle 10, Stockholm, Sweden

jannicke.baalsrud.hauge@kth.se

**Abstract.** The transition from the pre-defined and often inflexible tools and practices of institutionalized mass-education towards dynamic and flexible learning contexts remains a challenge. Enabling rich and engaging learning experiences that consider the different progression rates and routes of each student require new approaches in education. This paper analyzes opportunities for employing gamification and digital games to construct navigable dynamic learning channels and enable pathways towards turning users into adaptive learners able to reach learning goals both in structured and unstructured contexts.

**Keywords:** lesson plan, location-aware, game customization, Tingo

## 1 Introduction

In recent years, games have found a new application, as the era of gamification has been launched. Gamification represents the application of game-thinking, game dynamics, and game mechanics in non-game contexts, with the purpose of engaging users, increasing participation, facilitating learning, and solving problems [1]. Gamification has emerged as a strategy across various disciplines such as education, environment, government, health, marketing, web, mobile applications, social networks, etc. Applying gamification in each of these contexts require a deep understanding of the relationship between the needs of the gamification project and the appropriate choice of game elements to apply [2]. Research on gamification has bloomed, and design practices, such as the 6G framework [3] brought the promise of successful
gamification. At the core of gamification lies the following game element hierarchy
[3, 4]:

- *Components*: the specific examples of the higher-level features, such as points, virtual goods, quests, etc.

- *Mechanics*: the elements that drive player involvement and include elements like chance, turns or rewards.

- *Dynamics*: elements that provide motivation through features like narrative or social interaction.

Even if gamification brings the promise of engagement, there are also challenges to be considered when applying gamification mechanisms, especially in educational settings. Most elements used in gamification rely on competition and rewards. In games where competition lies as the core of the experience, we can identify two main categories: (a) head-to-head competition, where players compete directly against one another; (b) Asynchronous competition, where a player competes against other players by comparing the outcomes of their play [4]. These approaches cannot be applied as a universal solution. It is necessary to consider that each student has different needs and not all are motivated by competition [5]. Therefore, other mechanics need to be identified to lead motivation and engagement. Cooperative play experiences and chance-based play provide an alternative. In cooperative play, players can work simultaneously to achieve a common goal or take turns, in order to find success, while in chance-based games use randomness and chance to enhance the variety of decisions need to make. Such implementations reflect the basic human activity matrix that ranges from solo (hobby, audience, analysis) to competitive (job, sport, criticism) and collaborative activities (community, performance, teaching) [6]. Just like in non-digital or less technologized collaborative learning environments, where students work together on a collaborative assignment and at the same time they deepen their knowledge and their understanding [7], games have also the potential to increase participation in learning activities by enlarging availability of opportunities to collaborate; enhancing the accessibility of those opportunities, as well as the affordability [8].

Digital Educational Games build upon major learning theories [9]. In line with the behaviorism theory, games deliver stimuli to learners, gather their responses and provide feedback [10]. Following the constructivist approach, games involve learners in active processes, enabling them to construct new ideas or concepts based on their existing knowledge and experiences [11]. Social constructivism is applied in games by providing diverse cultural, language, and environmental contexts in which learning can take place. Connectivism is strongly represented in virtual environments [12], where the ability to make decisions [13], as well as nurturing and maintaining connections is explored to facilitate game achievements through continual learning.

While employing gamification to stimulate learning is the latest trend [14], the use of games in education has gained momentum in the last decade. However, designing games with a good game-play and immerse game players in a realistic setting while also encouraging re-playability is considered a true craft. Employing games in education require the consideration of the variables that influence learning and a learning theories need to be incorporated into the game design practices [15]. However, promising games are for the educational setting, a significant issue that needs to be ad-
dressed is the limited opportunities to tailor games for specific learning activities. Game customization remains a job for developers, even if efforts are being made to implement deeper levels of customization for end-users [16], [17], [18].

Learning experiences span from effortless to difficult, where the gratification of accomplishment is delayed [19]. The challenge is not to motivate; it is to support them finding a path to success. Coupled with technology advancement, at strategy level, the priorities for Education and Training 2016-2020 focuses on more open and innovative learning and teaching; sustainable and efficient investments in educational systems; relevant and high quality skills and competencies; inclusive education, equality, and non-discrimination; as well as strong support for educators.

The European Qualification Framework [20] also recognizes the need to support validation of non-formal and informal learning towards core skills such as literacy, numeracy, science, foreign languages; and horizontal skills such as learning to learn, social and civic responsibility, creativity, to support learners in finding personal fulfilment, and later in life find employment and engage in society. All require new approaches in pedagogical practices and experimentation in smart, scalable, inclusive learning environments.

Key to addressing these challenges is the flexibility and elasticity of the learning space, of its contents and assessment methods that enable the learning space be reshaped based on learners' needs, performance, abilities, as well as on the learning objectives that have to be met. Digitally supported pedagogy today still relies on pre-defined (rigid) learning contents and assessment methods, and learning systems that are too assistive, leading to a distorted learning outcome. They do not adopt student-centred learning and do not present the required level of flexibility to accommodate both structured and unstructured learning.

In the context of this paper, structured learning contexts are constructs that are modeled by teachers in order to implement a certain learning plan. Unstructured learning contexts are constructed by students based on given assignments. Constructing consistent, yet dynamic learning spaces is an increasingly important issue in the context of the advancement and expansion of technologies for learning and skill development.

This paper reports work in progress on designing gamified lesson plans that are applied in structured and unstructured learning contexts. This approach creates new levels of flexibility in reaching learning objectives by employing emerging gamification mechanisms and digital educational games.

## 2 CONSTRUCTING STRUCTURED AND UNSTRUCTURED LEARNING CONTEXTS

The shift towards more flexible learning implies the adoption of new methodologies and practices. The emergence of gamification and gaming technologies offer opportunities to construct new approaches to learning, giving learners more freedom, strengthening collaboration skills, and stimulating their creative mind.
This section presents the transition from a traditional classroom-based approach to a gamified approach that employs technology to build specific language competencies. In the context of this paper, structured learning is learning that is continuously regulated by the teacher; while an unstructured learning context occurs when the teacher initiates the learning, but does not impose the steps to achieve the learning objectives and meet the assessment metrics.

## 2.1 Classroom-based lesson plan

A significant part of the teaching activity relies on traditional methods, while the technology-oriented generations expect more engaging learning methods. Even if significant efforts are being made, the tradition from teacher-centers to student-centered education remains challenging. To address it, this paper follows the transition from conventional teaching methods to new approaches that integrate gamification and games as consistent stimuli for motivation and engagement.

Table 1 presents a lesson plan created for advanced English students in the 10th grade. The lesson plan details the curriculum objectives, the language skills that will be developed, the general and the specific objectives of the lesson plan, as well as the specific set of activities that will be carried out during the class.

<table><caption>Table 1. Classroom-based English lesson plan</caption><thead><tr><th colspan="2">Lesson topic: Târgovişte City – past, present and future</th></tr></thead><tbody><tr><td>Subject: English</td><td>Grade: 10<sup>th</sup></td></tr><tr><td>Level: Advanced</td><td>Time: 50 minutes (1 course)</td></tr><tr><td>Location: Classroom</td><td>ICT: PowerPoint presentation, video clips</td></tr><tr><td>Objectives set in the national language curriculum for the 10<sup>th</sup> grade, advanced level</td><td>Language skills targeted by the lesson plan</td></tr><tr><td>Objective 1. Comprehend oral and written messages in diverse contexts</td><td>Listening: receptive skill<br>Reading: receptive skill</td></tr><tr><td>Objective 2: Speaking or writing on diverse topics</td><td>Speaking: productive skill<br>Writing: productive skill</td></tr><tr><td>Objective 3: Oral or written collaboration</td><td>Speaking: productive skill<br>Writing: productive skill</td></tr><tr><td colspan="2"><strong>General objectives of the lesson:</strong><ul><li>To improve the student's vocabulary with words related to history, city architecture and civic responsibility</li><li>To develop communication and collaboration skills</li><li>To assess comprehension of oral and written messages</li><li>To enable students to use previous knowledge</li><li>To enhance civic engagement</li></ul></td></tr><tr><td colspan="2"><strong>Specific objectives to be achieved by the end of the lesson:</strong><ul><li>Students will be able to use vocabulary related to history and city architecture</li></ul></td></tr></tbody></table>
- Students will be able to recognize positive, negative, and neutral comments

- Students will be able to describe historical events and historical figures

- Students will be able to comprehend the oral and written messages given by the teacher concerning the history and architecture of Târgoviște City

- Students will be able to present ways in which they can participate in the life of the local community and can get involved in shaping the community's future.

### Teaching techniques

- Conversation

- Questions and answers

- Questionnaire

- Discussion

### Organization of the class

#### Activity 1 – Speaking

The teacher asks the students to comment on the role of the Târgoviște City as the former capital of Romania

#### Activity 2 – Reading

The students work individually. The students are asked to go scan a text that present the architectural styles of the buildings in the city and find out what is the topic of each new paragraph. After reading the text, the students do the exercise at the bottom of the text.

#### Activity 3 – Speaking, Listening

The students form pairs. They talk about different categories of buildings from Târgoviște. They are asked to match names with building images. After discussing in pairs, the students present their feedback to the rest of the class.

#### Activity 4 – Listening, Speaking

Before listening to a text on civic responsibility, the students make predictions about what they are going to hear.

The teacher reads the text on civic responsibility. Afterwards, the students discuss if/ how their perspective on civic responsibility has changed.

#### Activity 5 – Writing

The teacher asks the students to write a short composition on the buildings of Târgoviște, historical figures and civic actions that can be taken to preserve the historical heritage of the city and support its future development.

## 2.2 Gamified learning

Starting from the lesson plan presented above, to ease the transition to emerging teaching methods, a gamified approach has been constructed. Table 2 and Table 3 present a set of activities that can be implemented to enhance student engagement and motivation to learn.

<table><caption>Table 2. Structured indoor learning</caption><tr><td>Organization of the class</td></tr><tr><td>Activity: "Fill-in exercise" – Writing, Reading, Listening</td></tr></table>
Students will work in groups of four. Each group will choose a name for their team. Each team selects a letter. Each letter is associated with a different set of fill-in exercises. The set of exercises is divided into several levels of difficulty:

**Level 1. Vocabulary practice. (10 points/ 1 badge)**

The students will fill in the blanks with words they learnt in previous lessons. 1 point is given for each correct answer. 1 badge is given if the set of exercise is completed without errors.

**Level 2. Vocabulary practice. (20 points/ 2 badges)**

The students will match a given set of new words with the blank spaces. 2 points are given for each correct answer. 2 badges are given if the set of exercise is completed without errors.

**Level 3. Vocabulary practice. (30 points/ 3 badges)**

The students will listen to an audio message/ watch a clip presenting the historical buildings in Târgoviște City and fill-in the blanks. 3 points are given for each correct answer, as the level of complexity increases. 3 badges are given if the set of exercise is completed without errors.

*If the general and specific objectives of the lesson plan are extended to include grammar practice, the following levels can be added:*

**Level 4. Grammar practice. (20 points/ 2 badges)**

The students will fill-in the blanks with adjectives from a given list using the right degree of comparison.

**Level 5. Grammar practice. (30 points/ 2 badges)**

The students will fill-in the blanks with the right tense of the verb in brackets.

*To make the activity more interesting, hints can be placed in the classroom or within the school. The team that gathers the largest number of hints will get extra points. Time limits can be added to certain activities, in order to be able to comply with the estimated time of the lesson.*

The team that collects the largest number of points or the largest number of badges wins the game. Special credit is given to the teams that have obtained best results per level.

<table><caption>Table 3. Unstructured outdoor learning</caption><thead><tr><th>Activity: "Puzzle" – Writing, Reading, Listening, Speaking</th></tr></thead><tbody><tr><td>Students can play and collaborate to put together a map of Târgoviște City. Students will work in groups of six. Each group will choose a name for their team. Each team selects a different type of map: historical buildings, churches, modern buildings, favorite shops, memorial houses, parks, local markets, etc. All the documentation process is carried out outside the classroom. The role of the teacher is to set the goals of the game, without setting up rules or restrictions on how the research should be carried out or how the project should be elaborated.<br>Each team has to document their project with information and pictures of the buildings they have identified.<br>A team obtains or loses points based on the following criteria:<ul><li>Number of buildings included in the project. (10 points per building)</li><li>Quality of information. (1-5 points per building)</li></ul></td></tr></tbody></table>
- The originality of the work. E.g. *if pictures are taken by the team members and not from the Internet.* (30 points)

- Spelling mistakes. (-2 points per mistake)

- Grammar errors. (-5 points per mistake)

Evaluation is carried out by the competing teams and not by the teacher.

An example of smartphone app that provides information about points of interest around the current location of a user is Field Trip. The application is a good indication of what can be achieved in terms of user experience for the students (https://play.google.com/store/apps/details?id=com.nianticproject.scout). However, it is not tailored for a formal learning environment and does not provide any kind of APIs or reporting that could be used by teachers to select the list of relevant topics that should be provided or to understand how students have engaged with the information and how long they have been following a particular topic.

## 2.3 Blending technology into unstructured learning contexts

One of the key challenges in providing students with unstructured learning is to set up an environment where users can have access to on-demand knowledge that is relevant to their current context and desired learning outcomes.

Existing technologies offer opportunities to create rich learning experiences at user level, building upon wide databases and supporting large-scale reuse. The tools proposed therein are:

a. **DBpedia**, a project that provides semantically classified information that can be queried using a vast number of descriptors, including geo location. Because the resources contained in the datasets are classified semantically, it provides a straightforward way to retrieve these resources based on specific topic of interest and also to locate related content using knowledge graphs.

b. **Wikipedia**, the premier online open encyclopedia offers basic API functions that can search for articles that are in a specific radius from a particular geo location (https://www.mediawiki.org/wiki/Extension:GeoData#API). The limitation of this service is that it cannot be used to filter the results based on particular topics of interest. In some context this could be beneficial because students are exposed to the entire set of information that is available, but it can also be a factor that distracts their attention from the desired learning outcome.

c. **Wikimapia**, a service that aims to describe and categorize physical locations.

## 2.4 Game-enhanced learning with Tingo

Tingo is a Digital Educational Game developed by Advanced Technology Systems, Romania (http://desig.ats.com.ro/). The game was created to support foreign language learning, while coupling specific curricular competences and game activities.

A significant issue that occurs when teachers aim to employ digital games as support tools for learning is to adapt the game to the specific learning objectives within a lesson plan. To address this issue, the Tingo game has been designed to enable a basic
level of customization, allowing teachers to create simple learning contexts. The applied scenario builds upon location-aware technology.

Starting from a simple map, several game objects can be added to create a fantasy map of the city (Fig. 1). Information dragged from the tools presented in the above section and GPS coordinates can be added for each of the buildings included in the map.

<figure><img src="image_2.png" /><figcaption>Figure 1: Map of Târgoviște City in the Tingo game</figcaption></figure>

When the player explores the virtual world, the background images changes color for the areas the players has visited (Fig. 2).

<figure><img src="image_3.png" /><figcaption>Figure 2: Student activity within the game</figcaption></figure>

<figure><img src="image_4.png" /><figcaption>Figure 3: Student activity in physical locations</figcaption></figure>

When the player physically reaches a building, the game uses GPS coordinates from the device to determine the building and change its color on the map. If available, additional localization devices such as Bluetooth beacons or Wi-Fi base stations can also be used (Fig. 3).

In Tingo, individual players can set up their own bookcase. To collect books, players need to complete additional quests. Players can combine individual bookcases to form a public library.

To increase motivation, the game enable players to set up an individual vocabulary. As they progress in the game and learn new words, their individual vocabulary becomes larger and larger. The game displays a scoreboard with the following categories of players: (a) players that have the largest collection of words; (b) players that have the largest number of unique words that do not appear in other players' vocabulary; and (c) players that have the largest number of similar words.
Starting from specific competences that are targeted (Table 4), the activities presented in Table 5 have been created using the wizard feature of the game.

<table><caption>Table 4. Curriculum-based specific competences</caption><thead><tr><th colspan="3">Curriculum Objective 1.<br>Comprehending oral and written messages in diverse contexts</th></tr><tr><th>Reference</th><th>Specific competences</th><th>Support materials</th></tr></thead><tbody><tr><td>1.1</td><td>Anticipate the information in a text based on its title or a visual stimulus</td><td>Provide texts of various lengths and diverse difficulty</td></tr><tr><td>1.2</td><td>Identify the message in a given text</td><td>Provide audio/ video clips</td></tr><tr><td>1.3</td><td>Identify key information in original texts</td><td>Present dialogues</td></tr><tr><td>1.4</td><td>Identify details from oral/ written messages</td><td>Provide mass-media articles</td></tr><tr><td>1.5</td><td>Select information from several texts in order to fulfil a task</td><td>Provide authentic texts extracted from books</td></tr><tr><td>1.6</td><td>Identify the logical structure from a given text</td><td></td></tr></tbody></table>

<table><caption>Table 5. Unstructured outdoor learning</caption><thead><tr><th>Reference</th><th>Game activities</th></tr></thead><tbody><tr><td>1.1</td><td>The game displays several buildings and the player has to guess their category.<br>The player is requested to match different activities with building categories.</td></tr><tr><td>1.2</td><td>The game displays a text message and the player has to act upon the information the game has provided.</td></tr><tr><td>1.3</td><td>The game displays a text message and the player has to identify words from a certain category: e.g. nouns, verbs; or categories of buildings.</td></tr><tr><td>1.4</td><td>The player listens to an audio message and is required to perform certain tasks, such as click on the building that has been described in the audio message.</td></tr><tr><td>1.5</td><td>The game displays text messages that provide information on historical buildings in Târgoviște and the player is requested to classify them based on their architectural profile, the year they were built, etc.</td></tr><tr><td>1.6</td><td>The player is requested to identify the chronological order of the historical facts that are presented in several written or audio messages.</td></tr></tbody></table>

These scenarios can be extended to support, for example, problem based learning. By coupling learning foreign languages with other disciplines such as math, the lesson
plan on the architecture of the Târgoviște City can include specific tasks that address
math topics.

3 Discussion and Next Steps

Students will invariably experience different progression rates and routes, which often lead to different learning outcomes than those expected. This can be a consequence of several factors including the pre-defined and often inflexible tools and practices of institutionalized mass-education, but above all else emerge two key considerations: on one hand, learning is a choice, an act of personal agency and even if the best blend of technologies is available, without sustained motivation, learners will not truly engage in deep learning processes; on the other hand, when technologies are not available or are not easy to integrate into learning spaces, the experience might prove too frustrating even for motivated learners.

To address these challenges, it is necessary not only to turn ICTs into navigable dynamic learning channels, but also to enable pathways towards turning users into adaptive learners able to reach learning goals without a high dependency on certain technologies. Technology is a guide for learners and a mean to reach learning goals. Therefore, technology dependency should be avoided. The aim is to foster self-regulated learning by assisting learners in how to comprehend and realize when they do not know something and to stimulate discovery such that learners seek out the necessary knowledge or information. The immediate benefit of such a learning environment is that it affords ambient learning including adaptive and personalized teaching and assessment.

This approach contrasts to recent developments and solutions where the software is
too assistive letting the learner know what is ‘needed’ in every step of the learning
journey rather than letting the individual conduct reflective and summative learning.
Removing agency from the equation of learning (and teaching) has implications from
the pedagogical perspective. It limits the quality of the learning experiences by creat-
ing automatons and the consequential reliance of learners becoming highly dependent
on software.

Instead, the approach proposed in this paper follows a completely different paradigm, where learners are given the freedom of choice based on a plug&learn approach (e.g. smartphone apps; digital games). It considers the fact that the outcomes of learning experiences that occur outside of formal, structured settings are not assessed and valuable information about the learner is lost. Moreover, the solution proposed herein builds upon the fact that many students own mobile devices. This offers a significant opportunity for bring-your-own-X (device, cloud, applications, etc.) enabling individuals to find one tool that performs every function they need, removing the hassle of working with problematic tools that do not address all their needs.

The paper presents lesson plan scenarios that employ gaming technology to con-
struct engaging learning experiences. Future work involves the testing of the proto-
type and of the scenarios with students from different high schools, with the purpose
of extending the learning scenarios for problem-based learning and enhancing the
functionalities provided by the Tingo game.

Acknowledgement

The work presented herein is partially funded under the Horizon 2020 Framework
Program of the European Union, BEACONING – Grant Agreement 68676 and by
Unitatea Executiva pentru Finantarea Invatamantului Superior, a Cercetarii, Dezvol-
tarii si Inovarii (UEFISCDI) in Romania, Contract no. 19/ 2014 (DESiG).

4 References

[1] Davis, D. Z., Gangadharbatla, H. (2015). Emerging Research and Trends in Gamification. IGI Global.

[2] Deterding, S., Sicart, M., Nacke, L., O'Hara, K., Dixon, D. (2011). Gamification: Using game design elements in non-gaming contexts. CHI'11 Extended Abstracts on Human Factors in Computing Systems, 2425-2428. New York, New York: ACM.

[3] Hunter, D., Werbach, K. (2015). The Gamification Toolkit: Dynamics, Mechanics, and Components for the Win. Wharton Digital Press.

[4] Sharp, J., Macklin, C. (2014). Introduction to Game Design LiveLessons (Video Training). Addison-Wesley Professional. Rogers, S. (2014). Level Up! The Guide to Great Video Game Design, John Wiley & Sons.

[5] Information Resources Management Association. (2015). Gamification. IGI Global.

[6] Koster, R. (2013). Theory of Fun for Game Design. O'Reilly Media, Inc.

[7] Barkley, E. F., Patricia Cross, K., Howell, C. (2014). Major Collaborative Learning Techniques: A Handbook for College Faculty, Jossey-Bass.

[8] Connolly, T., Okada, A., Scott, P. (2012). Collaborative Learning 2.0, IGI Global.

[9] Trentin, G. (2010). Networked Collaborative Learning, Elsevier Science.

[10] DeSmet, A., Van Cleemput, K., Bastiaensens, S., Poels, K., Vandebosch, H., Malliet, S., Verloigne, M., Vanwolleghem, G., Mertens, L., Cardon, G., De Bourdeaudhuij, I. (2016). Bridging behavior science and gaming theory: Using the Intervention Mapping Protocol to design a serious game against cyberbullying, Computers in Human Behavior, Volume 56, Pages 337-351.

[11] De Gloria, A., de Freitas, S., Obikwelu, C., Read, J. C. (2012). The Serious Game Con-
structivist Framework for Children's Learning, 4th International Conference on Games and
Virtual Worlds for Serious Applications (VS-GAMES'12) Procedia Computer Science, Vol-
ume 15, Pages 32-37

[12] Isman, A., Techakosit, S., Wannapiroon, P. (2014). Connectivism Learning Environment in Augmented Reality Science Laboratory to Enhance Scientific Literacy, International Conference on New Horizons in Education, INTE 2014, Procedia - Social and Behavioral Sciences, Volume 174, 2015, Pages 2108-2115.

[13] Leadbetter, A., Pshenichny, C., Diviacco, P., Fox, P. (2014). Collaborative Knowledge in Scientific Research Networks, IGI Global.
[14] Urh, M., Vukovic, G., Jereb, E., Pintar, R. (2015). The Model for Introduction of Gamification into E-learning in Higher Education, Procedia - Social and Behavioral Sciences, Volume 197, Pages 388-397.

[15] Bishop, J. (2014). Gamification for Human Factors Integration. IGI Global.

[16] Kleinsmith, A., Gillies, M. (2013). Customizing by doing for responsive video game characters, International Journal of Human-Computer Studies, Volume 71, Issues 7-8, Pages 775-784.

[17] Behr, K.M., Huskey R., Weber, R. (2015). Chapter 14 - Creative Interactivity: Customizing and Creating Game Content, In Video Games and Creativity, edited by Garo P. Green and James C. Kaufman, Academic Press, San Diego, Pages 285-299.

[18] Nagle, A., Wolf, P., Riener, R. (2016). Towards a system of customized video game mechanics based on player personality: Relating the Big Five personality traits with difficulty adaptation in a first-person shooter game, Entertainment Computing, Volume 13, Pages 10-24.

[19] Burke, B. (2014). Gamify: How Gamification Motivates People to Do Extraordinary Things. Bibliomotion.

[20] http://ec.europa.eu/education/library/publications/monitor15_en.pdf