# Examining User Experience in an Augmented Reality Adventure Game: Case Luostarinmäki Handicrafts Museum

Kaapo Seppälä, Olli I. Heimo, Timo Korkalainen, Juho Pääkylä, Jussi Latvala, Seppo Helle, Lauri Härkänen, Sami Jokela, Lauri Järvenpää, Frans Saukko, et al.

► To cite this version:

Kaapo Seppälä, Olli I. Heimo, Timo Korkalainen, Juho Pääkylä, Jussi Latvala, et al. Examining User Experience in an Augmented Reality Adventure Game: Case Luostarinmäki Handicrafts Museum. 12th IFIP International Conference on Human Choice and Computers (HCC), Sep 2016, Salford, United Kingdom. pp.257-276, 10.1007/978-3-319-44805-3_21 . hal-01449440

HAL Id: hal-01449440

https://inria.hal.science/hal-01449440

Submitted on 30 Jan 2017

**HAL** is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
Examining User Experience in an Augmented Reality
Adventure Game: Case Luostarinmäki Handicrafts
Museum

Kaapo Seppälä¹, Olli I. Heimo¹, Timo Korkalainen¹, Juho Pääkylä¹, Jussi Latvala¹,
Seppo Helle¹, Lauri Härkänen¹, Sami Jokela¹, Lauri Järvenpää¹, Frans Saukko¹, Lauri
Viinikkala², Tuomas Mäkilä¹ & Teijo Lehtonen¹

¹Technology Research Center, University of Turku, Turku, Finland
{kaapo.seppala, olli.heimo, timo.korkalainen,
juho.paakyla, jussi.latvala, seppo.helle,
lauri.harkanen, sami.jokela, lauri.jarvenpaa,
frans.l.saukko, tuomas.makila, teijo.lehtonen}@utu.fi

²Department of Finnish History, University of Turku, Turku, Finland

lauri.viinikkala@utu.fi

**Abstract.** In this paper we examine the user experience test results of Augmented Reality Adventure Game designed to Finnish Cultural Heritage Site Luostarinmäki Handicrafts Museum in Turku and discuss about the possible and preferable content, development and economic decisions and guidelines for augmented reality applications for museum and Cultural heritage sites.

**Keywords:** Augmented Reality · Mixed Reality · Gaming · User Experience · Museum

# 1. Introduction

Augmented Reality (AR) is the art and technology in which traditional field of real world view is augmented with additional information. This can be computer-generated 2D and 3D images or information superimposed on the real-world view captured from the camera of smartphone, computer or other device [1]. Augmented image appears to its users like virtual and real objects coexisted in the same space. In other words, AR immerses its users in virtually enhanced real world [2].

Augmentation of reality has been used in different medias and systems for decades, e.g. head-up displays in fighter planes, scoreboards in sportscasts. Due to the computerisation and rapid emergence and development of mobile technology, AR is now available for common users in their mobile devices and possibly soonish with AR-glass technology.

The interest towards the emerging AR technology has been rapidly growing among the museums and cultural heritage sites around the world. However, the acceptance of
AR applications can vary in different populations. Lee & al. made a cultural comparison between South Korea and Ireland, both having high smartphone penetration rates but different cultural profiles, and noticed that aesthetics of AR have the strongest influence on perceived enjoyment. Also, as expected, South Korea, having high collectivism and high uncertainty avoidance culture, displayed stronger dependence on social influence and hedonic characteristics of AR. [3]

Smartphone or tablet device meets the main requirements posed by AR since it has a camera and capability of rendering and displaying the augmented graphics. [4] Hence, with explosive growth of penetration rates of smartphone, application-based AR has been more accessible to users. Especially, cultural heritage tourism is one of the most important areas served by mobile AR app [5, 6] which provides digitally restored artifacts, thereby preventing degradation of cultural heritage sites aggravated by frequent access by tourists and let them perceive fun and usefulness [7]. A number of cultural heritage institutions around the world, such as the Louvre Museum in Paris and British Museum in London, have developed and provided with their mobile AR apps<fnref n="1" />.

As this study is – as far as we know – the among the first studies about AR-games which involves end-users, the research questions reflect the overall requirement for these kinds of solutions and thus our research questions are as follows:

1) Is there a demand potential for AR adventures in cultural travel?

2) Does AR adventure generate added value to the museum experience?

3) Is an AR adventure suitable for museum and cultural travel atmosphere?

4) Are the customers willing to pay for it?

In this paper an Augmented Reality Adventure User Experience (UX) research results done in Finnish cultural heritage site *Luostarinmäki Handicrafts Museum* in Turku are introduced and discussed. The research team has been developing AR and Mixed Reality (MR) mobile applications (apps) for Finnish cultural and especially museum field to research this emerging technology's possibilities in presenting historically accurate and entertaining experiences to audiences. The paper is organized as first introducing the AR technology and our prototype, then our research design and results, followed by discussion and conclusions.

## 2. Reality... augmented?

> "What is real? How do you define 'real'? If you're talking about what you can feel, what you can smell, what you can taste and see, then 'real' is simply electrical signals interpreted by your brain."

> – Morpheus, The Matrix [8]

<footnote n="1">¹ See e.g. http://www.museum-id.com/idea-detail.asp?id=336, https://www.qualcomm.com/news/spark/2012/04/20/museums-modernize-self-guided-tour</footnote>
## 2.1. What is AR?

Whereas the more known virtual reality experiences attempt to recreate all of these signals, augmented reality only attempts to complement the natural ones with some artificial flavor. It thus sits somewhere in between the physical reality and completely simulated virtual reality, as seen in the famous Virtual Reality Continuum in Figure 1 [9].

<figure><img src="image_2.png" /><figcaption>Fig. 1, Levels of mixed reality</figcaption></figure>

Whereas virtual reality (VR) can deviate greatly from the real world, augmented reality productions however must fit into the physical context in order to achieve an immersive and believable experience. At the minimum a good AR application should 1) seamlessly combine the physical and virtual pieces of content, 2) be highly interactive in real-time and 3) allow users to experience the content with free movement in the real world 3D space. [10] The first condition is not to set limitations to artistic freedom in any sense, but to highlight the fact that at least the virtual content should in fact react to as many changes and parts of the real world as possible. The second condition separates for example pre-rendered movie productions from augmented reality, as even if the contemporary film productions feature highly believable computer generated imagery, they do not represent a real-time simulation of reality from the end-users point of view. The third condition then emphasizes how important it is to the end users not be limited in the ways they can “live” in the augmented space: they must be able to move freely and explore the content from any angle and location they like. The virtual content must always be fixed tightly in its place in the real world while the user moves about.

Augmented reality can be experienced via various types of devices. Currently the most used device platform is the mobile devices segment most consumers carry with them in their everyday life: mobile phones and tablets. The image from the rear camera of the device is displayed on the screen and the virtual content is drawn on top of it to create the seamless viewing experience. While traditional mobile devices allow widespread adoption of AR experiences, they can at most provide a window-type of experience into the augmented world. The next phase, currently taking its initial steps will be in form of wearable eyewear: with see-through displays both the real world and the virtual elements can in the future be overlaid on top of the whole field of vision (FOV). Such devices, but with limited FOV are being prepared for consumer grade release by several international corporations, such as Google, Microsoft and Sony and many others have announced intentions of going into the market [11, 12, 13].
The first wave of augmented reality applications for mobile devices used purely geolocation based solutions for aligning, registering, the content with the real world. With the user's geolocation and the device's orientation read from magnetometer and other sensors it is possible to do only very rough registering: the content might be meters away from the actual desired location and it usually also reacts to user's movements sluggishly and with imperfect results. Mostly the first applications were thus about displaying information about distant enough points of interest around the user, such as showing the restaurants in radius of 5 kilometers as seen in Here City Lens application in Figure 2.

<figure><img src="image_3.png" /><figcaption>Fig. 2. Here City Lens [14]</figcaption></figure>

To acquire more accurate results the modern augmented reality technologies employ visual tracking as part of the process. The image from the device's camera is algorithmically analyzed to find stable points that can be used as a reference to measure how the device is moved around. The reference points, or feature points, can then also be matched to pre-created set of reference points. If they match with high enough accuracy, the reference point can be deduced as the camera is pointed to predefined content area which has accurately placed virtual content. The currently more traditional approach with predefined content is to use basic printed imagery as recognizable 2D markers. Complex images with high contrast and thus high amount of stable feature points work more reliably, but in some cases even photographs can be used as markers.

The more developing way of tracking is to use 3D objects as markers. They can produce both more accurate and stable registration, but also allow more viewing directions than the 2D surfaces. 3D markers are however more time consuming to create and require more data and thus bandwidth to transfer and also require much more complex and computationally heavy algorithms to be used. Since in the last few years both mobile networks have gained higher transfer speeds and devices have become
more powerful, it is now possible to employ large datasets of 3D markers as the basis for mobile augmented reality applications. The next step for accurate registration lies in actual environments being used as markers, instead of just small objects. This however requires even more complex solutions, as for example changing lighting in outdoor environments creates new challenges for the current algorithms.

Solutions come in the form of both new sensors such as depth cameras [15] and also as new solutions to registration, as perhaps more than the actual feature points the registration could be based on the geometry of the real scenery. Even without directly depth sensing devices some steps to this direction can be taken by employing Simultaneous localization and mapping technology, SLAM, where the end-user's device's camera image is used to recreate the viewed scene as 3D geometry [16]. This way just different types of objects and surfaces could be recognized – not just the very objects used as reference material. With this approach it will be possible to create AR experiences that are not limited to be used in a single real world environment, but could instead automatically adapt to new surroundings.

As augmented reality technologies become more and more complex, the importance of professionally developed and maintained dedicated software libraries has become vital part of the industry. The wide range of end-user devices available and different tracking techniques required for varying situations makes even maintaining such libraries a daunting task, let alone developing and researching new complex algorithms for better results. Thus, the currently wide adopted solutions are sparse and only a few competitors exist. The most used easily available AR software library is the Vuforia SDK, currently owned by PTC Inc. after acquiring it recently from Qualcomm [17]. One of the many, but likely the most feature rich and most used open source library is the ARToolkit, which also was recently acquired by DAQRI [18]. For more simple use cases and targeted for non-technical users exist for example the Aurasma and Layar platforms, which both are mostly built around augmenting printed or other fiducial material [19, 20]<fnref n="2" />

In addition to just displaying information and small gadget type of application, there are some examples of more complex augmented reality products. Likely one most known one currently is the AR conversion of the famous sandbox game Mine-Craft, that Microsoft has used as part of its HoloLens demonstrations and advertising [21]. Even if VR is likely the more suited medium of the two for gaming, AR will probably also gain much traction from the sector.

## 2.2. Our prototype

One of the first augmented reality adventure games for mobile devices was developed during 2014–2015 as part of the Futuristic History project at Technology Research Center<fnref n="3" /> of the University of Turku for use in an outdoor museum environment which is illustrated in Figure 3. The game was to provide visitors with a more lively experience in the museum, as currently the once busy streets of the 1800’s town are

<footnote n="2">² See c.f. ar.utu.fi/mrdb for list of SDKs.</footnote>

<footnote n="3">³ Http://ar.utu.fi</footnote>
now mostly empty. By bringing virtual characters into the court yards it was possible
to demonstrate in a very concrete manner how people lived in the area and what they
were like.

Much care was placed on clothing, speech and especially building backstories for
the characters. In a very classical point-and-click adventure game approach, the play-
ers were given small tasks to complete in order advance in the story that in end turned
out to be about finding a missing wedding ring. Mostly the tasks were completed by
visiting different areas and getting the right virtual characters to give the player the
right information to proceed. The gaming experience was targeted to be as seamless
as possible, even though the advanced ALVAR 3D tracking technology provided by
VTT [22] was still experimental and not completely production level reliable. [6].

<figure><img src="image_4.png" /><figcaption>Fig. 3, Luostarinmäki Adventure [6]</figcaption></figure>

Most frequent individual problems while testing the application was related to
finding the AR content with 3D tracking. While the technology allowed us to not print
2D markers in the museum area thus preserving the original look of the cultural herit-
age site and structures which was a requirement from the museum. This unfortunately
caused some problems with technical functionalities because some of the users had to
spend some time before finding the augmented spaces thus weakening the experience.

**3. Research Method**

Even though several related mobile Augmented Reality applications have recently
emerged also in Cultural Heritage sites, most of them are developed to enhance the
visitor experience. AR applications which focus on gaming are limited as well as the
AR User experience studies with actual end-users.[23]

As the UX is in connection with the user environment and varying content, it cre-
ates challenges in setting research assumptions for Museum AR-Game User experi-
ence. There is no existing supporting or contradicting theories with similar combina-
tion of interactive content and actual museum audience as a target group. Also, according to Yin, the results of this kind of case studies are not generalizeable to populations [23, 24]

Our research assumptions are based on use case- and concept evaluations of AR applications for Cultural Heritage sites [23]. They include that 1) regardless of the technological limitations that can poverish the AR-User Experience and the users see augmented reality as suitable for museum and cultural travel environment, and 2) it generates added value to the visit[23], [25]. We also assume that there are 3) market potential for future AR solutions in museum and cultural travel sector.

The user experience study was conducted June 1st to June 18th 2015 and it included themes from various different technical features to the content and marketing. The data was gathered in a structured questionnaire, build in the application. The basic user data was gathered before the testing and the usability data after the testing was done. Target sample size was 150 visitors. Accidental sampling was used. Existing study subjects were encouraged to recruit more subjects into the sample. Full data set is gathered from 129 visitors.

The main objectives of the testing were to collect feedback for the AR/MR-application and its content from various user groups, to discover its possible usability problems and to validate consumer demand for related AR/MR applications and interactive content.

The practical arrangements included a *research base* outside the museum gate where the test persons receive the equipment and a free museum ticket as a reward, four iPads and a selection of headphones for the audio content. Research personnel included 1-2 researchers on site during opening hours. The testing event was advertised throughout media.

Themes of the research were:

a) *Sample structure* (Age, gender, gaming experience, etc.)

b) *Reception* (How the idea of AR was received)

c) *Usability* (Technical functionality, UI, easiness of use, learning, interactivity, use of audio)

d) *Content* (How the app guides the user/tutorials etc., storyline, gamified content)

e) *Consumer business related* (Demand, Willingness to pay for contents/apps, How the AR-experience is connected to the museum experience)

Sample structure (n=129) is shown by age and sex in Table 1 and level of education in Table 2:
<table><caption>**Table 1**, Age and Gender structure in study</caption><thead><tr><th>Age</th><th>Male</th><th>Other</th><th>Female</th></tr></thead><tbody><tr><td>07-12</td><td>14</td><td>0</td><td>10</td></tr><tr><td>13-18</td><td>6</td><td>0</td><td>3</td></tr><tr><td>19-24</td><td>2</td><td>0</td><td>10</td></tr><tr><td>25-34</td><td>15</td><td>0</td><td>9</td></tr><tr><td>35-44</td><td>10</td><td>2</td><td>15</td></tr><tr><td>45-54</td><td>3</td><td>0</td><td>12</td></tr><tr><td>55-65</td><td>4</td><td>0</td><td>5</td></tr><tr><td>65+</td><td>3</td><td>0</td><td>4</td></tr><tr><td>Other</td><td>2</td><td>0</td><td>0</td></tr><tr><td>Total</td><td>59</td><td>2</td><td>68</td></tr></tbody></table>

<table><caption>**Table 2**, Education structure in study</caption><thead><tr><th>Education<sup>4</sup></th></tr></thead><tbody><tr><td>1<sup>st</sup> level degree or less</td></tr><tr><td>2<sup>nd</sup> level degree in vocational school</td></tr><tr><td>2<sup>nd</sup> level degree in high school</td></tr><tr><td>Bachelor's degree</td></tr><tr><td>Master's degree</td></tr><tr><td>Total</td></tr></tbody></table>

This sample consists of museum visitors that were available to test the system in the outdoor museum during the test period. It represents the typical Finnish customers of Luostarinmäki Museum during the beginning of the summer season. This mostly consists of the customer base of the museum except those that could not participate for personal reasons or because of traffic (e.g. visitors within tourist groups with dedicated guides and thus unable to participate at all). Moreover the customer base for the museum varies by the time of the year and therefore e.g. school groups or those people having holidays later in the summer were not represented. [26] The prototype app had content ready in Finnish thus restricting the participation of non-Finnish speaking people.

## 4. Results

First questions after the background were about attitudes. Most of our test subjects were found to be quite enthusiastic about the app and thus almost all of them agreed with the questions “Museum visit can be entertainment” (99%) and “Museum visit can be learning” (97%) as illustrated in Figure 4. 78% of the people were interested in technology, 89% in culture and 88% in museums. Exactly 90 people out of the 129 (70%) were interested in gaming as is presented in Figure 5. (To note, the eldest were not that enthusiastic about it). Therefore, an indication towards a group of enthusiastic testers was found. Most of the test users were regular users of desktop computers and smartphones but only 60% of them used regularly tablets. Answers towards activities in digital gaming gave more heterogeneous answers.

<footnote n="4">⁴ Finnish Education system is 3-levelled: primary school (7 to 15 years of age), two different secondary schools (16 to 19): high school and vocational school and two different higher level school types: bachelor level (universities of applied sciences) and master level (science universities).</footnote>
<figure><img src="image_5.png" /><figcaption>Fig. 4, Attitudes towards museums</figcaption></figure>

<figure><img src="image_6.png" /><figcaption>Fig. 5, Interest in the app.</figcaption></figure>

As shown in Figure 6, in our study the share of active gamers (gaming every week) was found to be about 49% and the share of those who play digital games every month as 68%. This – even though the definition differs a bit – follows study [27] of playing in population, where 69% were considered players and 48% as active players.

<figure><img src="image_7.png" /></figure>
<caption>Fig. 6. Gaming activity.</caption>

It must be noticed that even tough 91% thought the first impression of the app was interesting, as shown in Figure 9 but yet only 81% stated that they understood the idea of the app. Moreover, it must be remembered that the actual percentage might be even lower. Those still in primary school and those who have at least master's degree got the best impression about the app.

<table><caption>**Table 3.** "First impression of the app was interesting" and number of museum visits</caption><thead><tr><th>"First impression was interesting"/Museum visits</th><th>Total</th><th>% of n</th></tr></thead><tbody><tr><td>Never visited the museum before</td><td>46</td><td></td></tr><tr><td>Strongly agree</td><td>33</td><td>71.7</td></tr><tr><td>Agree</td><td>10</td><td>21.7</td></tr><tr><td>Neither agree or disagree</td><td>1</td><td>2.2</td></tr><tr><td>Disagree</td><td>2</td><td>4.3</td></tr><tr><td>Visited 1-2 times</td><td>49</td><td></td></tr><tr><td>Strongly agree</td><td>25</td><td>51.0</td></tr><tr><td>Agree</td><td>18</td><td>36.7</td></tr><tr><td>Neither agree or disagree</td><td>4</td><td>8.2</td></tr><tr><td>No opinion</td><td>2</td><td>4.1</td></tr><tr><td>Visited 3-6 times</td><td>24</td><td></td></tr><tr><td>Strongly agree</td><td>18</td><td>75.0</td></tr><tr><td>Agree</td><td>5</td><td>20.8</td></tr><tr><td>No opinion</td><td>1</td><td>4.2</td></tr><tr><td>Frequent visitors (6+ times)</td><td>10</td><td></td></tr><tr><td>Strongly agree</td><td>9</td><td>90.0</td></tr><tr><td>Disagree</td><td>1</td><td>10.0</td></tr><tr><td>Total</td><td>129</td><td></td></tr><tr><td>Strongly agree</td><td>85</td><td>65.9</td></tr><tr><td>Agree</td><td>33</td><td>25.6</td></tr><tr><td>Neither agree or disagree</td><td>5</td><td>3.9</td></tr><tr><td>Disagree</td><td>3</td><td>2.3</td></tr><tr><td>No opinion</td><td>3</td><td>2.3</td></tr></tbody></table>

As shown in Figure 7, the AR app and the pleasantness of the AR experience was seen quite differently: the experience can be pleasant even though the app is still seen less so. While 84% saw the experience as a pleasant one, only 59% of users confirmed that the app was pleasant to use thus indicating clear problems in the usage of the app. The pleasantness of the app's use was one of the lowest scores gathered and can be combined with the problems and feedback in functionality (see below). Males were more demanding for the experience than females.
<figure><img src="image_8.png" /><figcaption>Fig. 7, AR experience overall and by gender.</figcaption></figure>

Whether the app is seen as a pleasant one depends hugely on the age group. People from 25 to 34 years of age are most critical towards the app and demanded better experience while children of 7 to 12 years of age were quite pleased with the application which is illustrated in Figure 8.

<figure><img src="image_9.png" /><figcaption>Fig. 4, "The app was pleasant to use" by age.</figcaption></figure>
Even though the app got a lot of positive feedback, the functionality got even less
praises than the pleasantness (22% bad or very bad, see Figure 9). As mentioned in
chapter 2, this and the pleasantness-problem can partly be explained with several
issues with tracking.

<figure><img src="image_10.png" /><figcaption>Fig. 9, App functionality.</figcaption></figure>

In Figure 10 is illustrated the results for questions about movement with device.
The using of the device and moving with it was found easy enough even though the
museum grounds are in unpaved hillside with lots of obstacles.

<figure><img src="image_11.png" /><figcaption>Fig. 5, Easiness of use in navigation and movement.</figcaption></figure>

The storyline and gaming time (c.a. 45min) was found to be fine, but problems
arose within the museum pedagogic level of the app which according to the testees
was not that visible. Moreover the hardship of separating fact from fiction caused
24% of users some issues, as illustrated in Figure 11.

<figure><img src="image_12.png" /><figcaption>Fig. 11, Opinions about content.</figcaption></figure>

The adventure length – as seen in Figure 12 – was seen as a proper length but yet people wished both more and less scenes to the app. Most of the users were quite gratified on the amount of content presented. More historical background information was still requested by most of the users, as shown in Figure 15. Thus, it seems that the most of the testees required more historically in-depth content within the same time amount while the requirement for the amount of scenes (and thus the length of one scene) was more heterogeneous in variance.
<figure><img src="image_13.png" /></figure>

<figure><img src="image_14.png" /></figure>

<figure><img src="image_15.png" /></figure>

<figure><img src="image_16.png" /><figcaption>Fig. 6, requests by the testees</figcaption></figure>

Most of the testees would be enthusiastic to continue their adventure later on outside the museum area, as illustrated in Figure 13. The age group 35-44 was the most eager in this. Yet again the question did not specify the means in continuing the adventure and thus more specific research on the subject is recommended to further develop the possibilities in connecting the on-site experience with off-site experiences.

<figure><img src="image_17.png" /></figure>

<figure><img src="image_18.png" /></figure>
<caption>**Fig. 7**, Eagerness to continue the adventure after the museum visit.</caption>

In Figure 14 it is shown that while it seems that the users were quite pleased towards the app and 78% of them saw that the “application brought added value to the museum visit”, many of them saw the idea of paying for the application in a different light.

However, only one third (32,5 %) of them would have wanted to pay for the test application. The museum experience as a whole was seen more valuable when combined with the AR experience but more evidence is needed to validate and increase the demand ratio and the total amount of possible customers for the sole application.

When considering commercializing alternatives of Augmented Reality content for Cultural Heritage sites, the results show that user groups vary also regarding their favourite business model. In other words the testees were relatively evenly distributed in terms of how the AR content could be offered for a museum visitor.

<figure><img src="image_19.png" /></figure>
<figure><img src="image_20.png" /><figcaption>Fig. 8, the value of the app and willingness to pay.</figcaption></figure>

Thus, there seems to be a requirement for extended adventure after the experience, our study shows no clear guidelines to what kind of extended adventure it should be. There are several possibilities – all taken from the gaming industry – by making payable content, by tying the use of extra content in social media or selling additional content or features afterwards [28].

There does not seem to be clear evidence that there would be a single *one-fits-for-all* commercialization method as the prizing and delivery preferences varied amongst the testees. Augmented reality technology is yet emerging and thus unknown but still quite fascinating media to most museum visitors.
## 5. Discussion

It must be kept in mind that the app tested was a prototype – and the testees were aware of that. Still, the understanding and vision of a prototype by a developer or IT professional varies from the understanding of a standard test person. Therefore the test data does not provide definite answers but a guideline for development and some understanding of the possibilities and market share.

The feedback the app received was generally very good: most of the feedback came back as either positive or very positive and thus, the general line must be derived from the fact that people were testing the product with positive mindset. The product got obviously a lot of credit and thus positive feedback on being free and in prototype state: similar functionality issues on a e.g. 8€ product would have gotten a lot of negative feedback. In our understanding based on the testing the robustness of the tracking functionality would be the primary key in promoting the whole usability and thus develop the user experience but to point out that correctly more research is required.

The AR-experience in the Luostarinmäki was found to be very pleasing and, combined with the perceived value added, it clearly indicates that there is a demand in enchanting the museum experience with augmented reality content. This indicates positive results for research assumption 1.

The testees were quite pleased with the idea of using a tablet for an augmented reality adventure in a museum-style heritage site even though the site itself was not as easy terrain and thus not as accessible for everyone as one could hope for, and there were challenges in some technical functionalities. Some elements from the other media (e.g. products from gaming industry), especially for the males in age group 25 to 34, could be promoted to further develop the experience for this most demanding testee group. If the target audience is younger (7-12) or older than the aforementioned 25 to 34, there is not that great of demand for game-like appearance and functionality. The storyline was found good and the length of the adventure (45 min) was found proper. The amount of historical elements to the story were found a tad wanting and thus more information both to promote the historical information and specially so that the users can separate of fact from fiction require more work, but overall for a product that is first of its kind the reception was excellent. We argue that this answers to research assumption 1 & 2 showing that the AR experience adds value to the museum experience and that AR is indeed – when generated promoting the historical values – suitable for museum and culture travel atmosphere.

There seems to be no good basis for comparison since there are no similar products in the market, so the market analysis is rather hard. Although the application was known to be a prototype with limited features, the willingness to pay was low in comparison to the value added perceived. Still we argue that the rate of one third (32,5 %) in willingness to pay is rather adequate for a decent marketing potential. Yet it is harder to analyse the true market potential of AR in museums and cultural travel, but we argue that with the positive attitude received from the testees in this study, the amount of possible customers should rise when this technology comes more commonplace. Although we must admit that the results to back up the research assumptions
tion 3 are not enough and the question remains still unanswered. Thus researching this
shall remain as one of our research focuses in the research yet undone.

**6. Conclusions**

Augmented reality adventures for museum and cultural travel seem to have de-
mand potential and it seems to add value to the museum and cultural travel experience
to be a meaningful addition worthy to create. It also seems to be – when created pro-
moting the historical values – suitable for cultural heritage atmosphere.

As discussed before, there is no single one-fits-for-all commercialization method as the prizing and delivery preferences varied amongst the testees. As the technology is yet emerging and unknown to most museum visitors we suggest low-threshold approach in engaging the possible future customers with easy access to the content provided while promoting the possibilities for new and exciting experiences.

The potentiality for selling new additional content should increase when the audi-
ences become familiar with the AR technology. Overall it seems these kind of apps
have their place in the markets and there are several people who are willing to pay for
them. The question remains is there enough and if, when? The inclusion of the app
prize to the museum visit or charging a separate payment – or any other funding
method – is yet another thing that should be researched more upon.

To further understand the negative feedback gotten in this project, we need to dis-
tinguish the frustration over functionality, usability issues and overall lack of interest
from each other. Our next goal in future studies is to promote the separation of fact
and fiction in the storytelling. We are doing more research in the field of cultural
heritage AR applications and thus will continue studying also the UX aspects further.
Moreover we aim to create guidelines on how the future apps for cultural and muse-
um sites should be constructed.

**References**

1. Bujak, Keith R. , Radu, Iulian, Catrambone, Richard, MacIntyre, Blair, Zheng, Ruby and Golubskic, Gary, “A psychological perspective on augmented reality in the mathematics classroom”, Computers & Education, Volume 68, October 2013, Pages 536–544 (2013)

2. Di Serio, Ángela, Ibáñez, María Blanca and Carlos Delgado Kloos, “Impact of an augmented reality system on students' motivation for a visual art course”, Computers & Education, Volume 68, October 2013, Pages 586–596 (2013)

3. Hyunae, Lee, Chung, Namho and Jung, Timothy, "Examining the cultural differ-
ences in acceptance of mobile augmented reality: Comparison of South Korea and
Ireland." Information and Communication Technologies in Tourism 2015. Spring-
er International Publishing, 2015. 477-491 (2015)

4. Henrysson, Anders and Ollila, Mark, “UMAR: Ubiquitous Mobile Augmented Reality“, MUM ’04 Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia, Pages 41-45 , ACM New York, NY, USA ©2004 (2004)
5. Portalés, C., Lerma, J. L., & Pérez, C., "Photogrammetry and augmented reality for cultural heritage applications." The Photogrammetric Record, 24(128), 316-331 (2009)

6. Viinikkala, Lauri, Leskinen, Olli-Pekka, Heimo, Olli, Korkalainen, Timo, Mäkilä, Tuomas, Helle, Seppo, Pönni, Veijo, Arimaa, Juha-Pekka, Saukko, Frans, Pääkylä, Juho, Jokela, Sami and Lehtonen, Teijo, "The Luostarinmäki Adventure – An Augmented Reality Game in an Open Air Museum". NODEM 2014 – Engaging Spaces – Interpretation, Design and Digital Strategies (2014)

7. Haugstvedt, A. C., & Krogstie, J., "Mobile augmented reality for cultural heritage: A technology acceptance study", In Mixed and Augmented Reality (ISMAR), 2012 I.E. International Symposium on (pp. 247–255). Atlanta, GA: IEEE (2012)

8. IMDB, "The Matrix (1999) - Quotes - IMDb",
http://www.imdb.com/title/tt0133093/quotes accessed
19.11.2015 (2015)

9. Milgram, Paul, Takemura, H. Utsumi A. Kishino F., "Augmented Reality: A class of displays on the reality-virtuality continuum" (pdf). Proceedings of Telemanipulator and Telepresence Technologies. pp. 2351–34. Retrieved 2007-03-15 (1994)

10. Azuma, Ronald T., "A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments" 6, 4 (August 1997), pp. 355 - 385. Earlier version appeared in Course Notes #9: Developing Advanced Virtual Reality Applications, ACM SIGGRAPH 1995 (Los Angeles, 6-11 August 1995), 20-1 to 20-38. The most referenced publication in the field of AR. One of 50 influential journal articles selected by MIT Press. from over 80 MIT Press journals from 1969 to 2011, covering all academic fields (1997)

11. Google, "We're graduating from Google[x] labs",
https://plus.google.com/+
GoogleGlass/posts/9uiwXY42tvc,
accessed 20.11.2015 (2015)

12. Microsoft, "Microsoft HoloLens | Official Site"
http://www.microsoft.com/microsoft-hololens/en-us, accessed 20.11.2015 (2015)

13. Sony (2015,.) "SmartEyeglass Developer Edition SED-E1",
http://developer.sonymobile.com/products/smarteyeglass/
, accessed 20.11.2015 (2015)

14. Nokia, "HERE City Lens - Viewfinder | Nokia"
http://company.nokia.com/en/news/media-library/image-
gallery/item/here-city-lens-viewfinder, accessed 17.11.2015.
(2015)

15. Mika Taskinen, Olli Lahdenoja, Tero Säntti, Sami Jokela and Teijo Lehtonen, "Depth Sensors in Augmented reality Solutions. Literature Review," University of Turku Technical Reports, No. 10, September 2015. Available at: https://www.doria.fi/handle/10024/116043, accessed 29.01.2016 (2015)

16. Durrant-Whyte, H.; Bailey, Tim, "Simultaneous localization and mapping: part I," in Robotics & Automation Magazine, IEEE, vol.13, no.2, pp.99-110, June 2006 doi: 10.1109/MRA.2006.1638022 (2006)
17. PTC, "PTC Acquires Vuforia | PTC"
http://www.ptc.com/about/history/vuforia, accessed 19.11.2015
(2015)

18. DAQRI, "Press release: DAQRI acquires augmented reality software pioneer ar-toolworks, makers of open source augmented reality platform, ARToolKit"
http://daqri.com/pressPosts/press-release-daqri-acquires-augmented-reality-software-pioneer-artoolworks-makers-open-source-augmented-reality-platform-artoolkit/#.Vk3oZ3YrJLI accessed 19.11.2015 (2015)

19. Aurasma, "Aurasma Home page" https://www.aurasma.com accessed 20.11.2015 (2015)

20. Layar (2015), "Augmented Reality | Interactive Print | Layar"
https://www.layar.com, accessed 20.11.2015

21. Gizmodo, "I Played Minecraft With Microsoft's HoloLens, And It Was Pretty Awesome" http://gizmodo.com/i-played-minecraft-with-microsofts-hololens-and-it-was-1711830768, accessed 17.11.2015 (2015)

22. Rainio, Kari, Honkamaa, Petri and Spilling Kaisa, "Presenting Historical Photos using Augmented Reality." ARea15 11.-12.6. 2015, Turku, Finland (2015)

23. Pendit, UC, Shiratuddin N, & Zaibon SB., Augmented Reality in Visual Communication: Innovation in Conservation of Historical Buildings. In: Proc of 2nd International Conference of Communication & Media, Penang, Malaysia, page 93-94 (2012)

24. Yin, R. K., Case study research: Design and methods (3rd ed.). Thousand Oaks, CA: Sage (2003).

25. Marimon D, Sarasua C, Carrasco P, Álvarez R, Montesa J, Adamek T, Romero I, Ortega M & Gascó P., MobiAR: Tourist Experience through Mobile Augmented Reality. In: Proc of 2010 NEM Summit, Barcelona, Spain, (2010)

26. Turku Museum Centre (2015), Personal interviews with museum guides.

27. Mäyrä, Frans & Ermi, Laura, "Pelaajabarometri 2013: Mobiilipelaamisen nousu", University of Tampere (2014),

28. Kimppa, Kai K., Heimo Olli I. and Harviainen, J. Tuomas, "First dose is always freemium", ETHIComp 2015, in ACM SIGCAS Computers and Society – Special Issue on Ethicomp. Vol 45. No 3 (2015)

## Acknowledgements

The project is funded by Tekes, the Finnish Funding Agency for Technology and Innovation. We appreciate also the partnership of public and private parties involved: Amos Anderson Art Museum, KOy Casagrandentalo, The Chemical Industry Federation of Finland, EnkeliGroup Oy, Evangelical Lutheran Church of Finland, Finnish Aviation Museum, Kilt Oy, Maritime Centre Vellamo / Museum of Kymenlaakso, Automobile and road museum Mobilia, Nimble Devices Oy, The Museum Centre of Turku, Museum of Technology, Muuritutkimus Ky, National Board of Antiquities,
Silencio Oy, Turku and Kaarina Parish Union, Museum Centre Vapriikki, Vucom, Bryggman Foundation, Regional Council of Southwest Finland / Lounaispaikka.