# Exploring Spatial Menu Representation and Apartment-Based Categorization for Online Shopping

Marco Speicher, Nadja Rutsch, Antonio Krüger, Markus Löchtefeld

► To cite this version:

Marco Speicher, Nadja Rutsch, Antonio Krüger, Markus Löchtefeld. Exploring Spatial Menu Rep-
resentation and Apartment-Based Categorization for Online Shopping. 17th IFIP Conference on
Human-Computer Interaction (INTERACT), Sep 2019, Paphos, Cyprus. pp.33-54, 10.1007/978-3-
030-29384-0_3. hal-02544604

HAL Id: hal-02544604

https://inria.hal.science/hal-02544604

Submitted on 16 Apr 2020

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# Exploring Spatial Menu Representation and Apartment-based Categorization for Online Shopping

Marco Speicher<fnref n="1" />,<fnref n="2" />, Nadja Rutsch<fnref n="1" />,<fnref n="2" />, Antonio Krüger<fnref n="1" />,<fnref n="2" />, Markus Löchtefeld<fnref n="3" />

**Abstract.** This work aims to explore, design and implement better and intuitive categorization schemes and menu representations for online shops that enrich and improve the shopping experience. We utilize the Apartment metaphor, in which products are categorized into rooms and furniture representing departments and shelves. Furthermore, we developed a realistic and interactive map-based spatial menu representation based on prior research findings. In a comparative user study, we evaluated our new menu categorization and representation in comparison with the current standard in online shops, based on real data from a local retailer. The results show that our apartment-based categorization in combination with a spatial representation outperforms all other conditions regarding all tested variables of performance (success rate, task completion time) and preferences (user experience, usability, workload).

**Keywords:** online shop · product categorization · menu representation · usability · user experience.

## 1 Introduction

Nowadays, online shops such as *amazon.com* or *zalando.com* are a well established and indispensable part of our everyday life. They often offer a better product availability, time savings and higher comfort compared to physical stores since purchases can be made from the comfort of ones home [35]. These factors have lead to an enormous growth that is anticipated to continue [23, 34]. While in 2017, only 10.1% of worldwide purchases were made online this is expected to grow to 15.5% by 2021⁴.

While the design and interaction techniques of online shops have changed and improved over the last years, due to a higher focus on user experience and usability [11, 16, 41], they are still mainly focused on product presentation and purchase transactions. Especially the search bar functionality, where powerful

<footnote n="1">¹ German Research Center for Artificial Intelligence (DFKI)</footnote>

<footnote n="2">² Saarland Informatics Campus (SIC), Saarbrücken, Germany
{firstname.lastname}@dfki.de</footnote>

<footnote n="3">³ Aalborg University, Aalborg, Denmark
mloc@create.aau.dk</footnote>

<footnote n="4">⁴ https://tinyurl.com/y8akourk</footnote>
algorithms are used to improve efficiency of customer searches, has received most attention [26]. Compared to this, product search and explorations using a menu interface has been largely neglected. Even though contrary to common belief, product searches via a search bar have been proven to be not necessarily preferred by the user nor are they generally more effective [14]. Especially when an online shopper does not know the explicit name of the desired product or is simply “just looking”, the search bars might not be a suitable solution. Customers that want to browse through the products using a specific category, e.g. if they are looking for a gift on menus for product exploration. Thus, it is important to further investigate possibilities of menu optimization.

Although the benefit of visualizations used in online shops is well known, menu representations are still mainly text-based. Furthermore, the underlying categorization depicted by the menu is often inconsistent throughout different online shops which makes it difficult for the customer to understand the underlying classification [27]. Therefore, in this paper we explore the usage of the Apartment metaphor [1] as a menu representation for online shops. It exploits the users familiarity with an apartment environment and categorizes products based on their association to rooms and furniture to make them easier to explore for the user. We present the development of the categorization of the different products as well as spatial visualization showing the floor plan of an apartment or a store to explore the different categories. Our comparative evaluation shows that an apartment-based online shop menu outperforms classic linear store-based menu structures in task performance, usability and user experience. Hence, this work contributes to the further development of online shop menus by:

- A study of an online shop prototype was conducted and evaluated four combinations of menu representation and categorization based on related work with respect to task performance and user preference.

- User insights and actionable improvements were provided for designing and developing future shopping environments.

# 2 Background

Prior works relevant to the here presented approach include those addressing (1) menu representations, as well as (2) menu categorization will be discussed here. Furthermore, we present an analysis of the menu structures of current popular online stores.

## 2.1 Menu Representation

Menu-guided interfaces have long been a prominent user interface component of software applications or websites and serve to structure the underlying amount of information hierarchically. Therefore a variety of different menu representations have been explored in the past. Miller et al. [21] examined the effects of menu width and depth on speed and accuracy. Their results were confirmed by Zaphiris
et al. [42], which showed that flat hierarchies are easier and faster to use and lead to greater orientation and satisfaction, and shorten interaction times. This has been recently also confirmed by Zhang et al. [43] in their extensive study on web shop menus. But in their study they also investigated the difference of menu positioning. While early work showed no clear recommendation, and only a tendency towards menus at the top of the screen [24], Zhang et al. showed that top-positioned menus were faster for product search, while top and left-positioned menus were preferred. This confirms that linear menu variants are recommended for use in online shops. Based on these findings, we have developed a reference menu for our comparison study.

Cockburn et al. [5] investigated different approaches to improve the traditional linear menus in terms of performance and preference. They compared standard and shared menus [33], and showed that frequency split menus were the fastest. However, the use of frequency split menus in an online shop might be problematic as highlighting frequently selected but potentially unwanted objects would not lead to any improvement, and could lead to frustration and confusion [22]. Findlater et al. [6] used a prediction algorithm to determine menu items that the user probably needs and showed that they enable faster menu selection. As shopping is a changing process – i.e. the offer and the interests of customers are constantly varying – the use in online shops does not appear promising for the process of exploration and is therefore not considered in this work.

Ahlstrom et al. [2] compared different menu designs and their results show that a squared menu is faster and is preferred which indicates that a spatial and rasterized arrangement could lead to better usability. Similarly Scarr et al., structured items hierarchical in a grid in the *CommandMaps* menu [30]. Their comparison to a ribbon menu interface (known from Microsoft Word) demonstrated that *CommandMaps* are faster and require fewer pointing activities, since the user no longer needs to change menu levels and benefits from spatial memory. In the same line of exploiting spatial memory also Vrechopoulos et al.[39] examined how different “brick-and-mortar” layouts can be transferred into a virtual retail environment. They showed that a *grid* based on a tree structure is easier to handle, which is furthermore supported by Griffith [7].

In summary, an adjustment of the menu representation can lead to higher objective performance [21, 6, 30] and/or better subjective preference [42, 5, 2]. Deeper menus, i.e. menus with many layers, increase complexity and slow down interaction times, so that the width (number of menu items in the layer) is preferable to depth [14, 21, 13, 25, 40, 42]. Moreover, it is advisable to minimize the menu depth without increasing the width extremely and on condition that the semantic data allow such a distribution [21]. The reference menu used in this paper is based on [43], representing the state-of-the-art of traditional linear menus in current online shops. Furthermore, we developed a spatial menu representation in the line of Vrechopoulos et al. and Griffith [39, 7].
## 2.2 Menu Categorization

Besides the representation and arrangement, especially a meaningful and comprehensible categorization of the menu items is important for efficient menu interactions. Katz and Byrne's investigation of menu interfaces for e-commerce environments highlighted the importance of high quality categories [12]. This is also confirmed by the work of Tuch et al. [38], who showed that a good categorization with a high information content can lead to a higher feeling of user-friendliness. Larson and Czerwinski [14] recognized the importance of a semantically founded categorization and integrated this fact into their research on width and depth of menus. In addition, Miller and Remington [20] also emphasize the necessity of both aspects, menu representation and categorization, due to their direct interdependence, i.e. both aspects influence each other in terms of task performance and user preferences.

Usually one differentiates between hierarchical (or faceted) categories and automated clustering [10]. While fully automated clustering according to the similarity of words or phrases has the advantage here, a quick structuring of information collections often leads to logical inaccuracies in contrast to the manually created hierarchies, which are rather preferred by users [10]. Practical examples also show how the categorization of menu items influences user performance, more precisely that users work faster with optimized menu categorizations [32]. Resnick and Sanchez [28] confirm the influence and effect of high-quality menu labels against those with lower quality. The use of meaningful and comprehensive menu labels is therefore an essential.

Adam et al. [1] presented a new categorization and representation scheme to enable intuitive menu navigation. Their spatial “Apartment” metaphor maps the mental model of an apartment with different rooms (living room, kitchen, etc.) to a structure of a smart-home control interface. The top level of categorization corresponds to the room category, followed by a device level and finally a task level that contains the potentially possible system tasks of the selected device. A similar approach has been utilized by Speicher et al. [36] for a virtual reality store. They found that the apartment metaphor provided excellent customer satisfaction, as well as a high level of immersion and user experience. The positive effects of the Apartment metaphor on task performance and user preferences serves as a basis and motivation for the menu categorization of the online shop prototype developed in our work.

## 2.3 State-of-the-art Analysis

Even though related work recommends to abandon linear store-based menu interfaces, most current online shops are still employing these. Table 1 lists a selection of popular online shops and their used categorization and representation. While we do not claim this to be the most representative selection it contains some of the most frequented stores. All of them use a linear representation in which the items are arranged horizontally or vertically. Some of them also integrate a multi-column menu display, e.g. the IKEA interface contains a
<table><caption>**Table 1.** Overview of state-of-the-art online shops for groceries, electronics, furniture or fashion. For the representation the first number is the menu depth, the second is the width of the top-level. These online shops have been accessed on August 21st, 2018.</caption><thead><tr><td>online shop</td><td>categorization</td><td>representation</td></tr></thead><tbody><tr><td>amazon.com</td><td>product range, theme</td><td>(4, 20)</td></tr><tr><td>conrad.com</td><td>product range, theme</td><td>(4, 8)</td></tr><tr><td>ikea.com</td><td>product range, theme, room</td><td>(3, 24)</td></tr><tr><td>carrefour.fr</td><td>product range, theme</td><td>(3, 17)</td></tr><tr><td>rewede</td><td>product range, theme</td><td>(3, 12)</td></tr><tr><td>tesco.com/groceries</td><td>product range, theme</td><td>(4, 11)</td></tr><tr><td>tesco.com/direct</td><td>product range, theme</td><td>(5, 12)</td></tr><tr><td>zalando.com</td><td>product range, theme, target group</td><td>(4, 3)</td></tr></tbody></table>

two-column menu at the top level. There are significant differences in the menu width from 3 to 24 items, in contrast to the depths between 3 and 5 levels. This is in line with findings from previous work [14]. In current online shop menus, the individual menu items are predominantly text-based, while current research recommends more graphical methods. Only three of the eight online shops (*REWE*, *CARREFOUR*, *IKEA*) additionally integrate icons illustrating the associated text label, while three menus (*CONRAD*, *REWE*, *TESCO direct*) also show the number of sub-level items.

Besides the representation, the logical meaning of the underlying categorization is important. All considered menus in Table 1 use mixed categories, i.e. following different sorting strategies within a menu level. Mostly, however, the categories are based on a combination of assortments and themes known from physical shops. For example, the category “beverages” refers to an assortment, the category “baby” to a theme. Studies have shown that such a mixture of categories can be unclear to the users, since the labels do not clearly describe the underlying information space, which is essential to give the user an overall impression of the search space [10]. Especially occasional users or new customers who are not familiar with the specific occurrences of a new or existing shop interface could be particularly frustrated, resulting in a negative effect on performance and preference. In the worst case, it could lead to shopping attempts being cancelled and the shop not being visited again [18]. Our state-of-the-art analysis indicates that current online shops do not follow findings on menu optimization and tend to use classical methods that have already been established.

## 3 Approach

The purpose of this paper is to explore the usage of the Apartment metaphor for categorization in combination with a spatial representation as a new menu type for online shops. Therefore we re-categorized products from a set of previous categories (departments or themes and shelf names), which are more likely
to be found in a physical market, to residential categories as part of a pilot
study. Based on these categories we developed a spatial menu representation, as
an alternative to the traditional linear menu. This results in the following sum-
marized menu representations and categories to be compared in our conducted
main experiment:

- Representations

• Linear

• Spatial

- Categorizations

• Store

• Apartment

To test and compare these four menu types and combinations of both repre-
sentations and categorizations, they were integrated into an online shop proto-
type. As the basis for our menu we selected a set of 36 products, that represent
the core areas of online trading. These products were selected from a local hy-
permarket with an associated online shop and is based on its frequently searched
products. The 36 products included belong to various traditional product areas
such as food, office supplies, clothing, electronics and others.

**3.1 Representations**

Representations of menus vary in the arrangement of the items on the screen. This can affect the search time to find a desired menu item visually, as well as the time to point and click [2, 4, 37]. We examine two different representations here: *linear* and *spatial*.

**Linear** The linear menu is most common in today's web interfaces such as online shops [43]. Here the menu items are arranged so that they form either a horizontal or a vertical line, usually with text labels. Since horizontal linear menus are recommended at the top of the screen [43], this combination is used as a reference menu representation. The depth and width of a linear menu depends on the underlying categorization (see Figure 1).

**Spatial** Our spatial menu representation is influenced by earlier findings on the grid arrangement [2, 30] and floor maps [19], which are often used in shopping malls, e.g. as printed maps. We use a spatial representation – a map –, based on real environments, where menu items are arranged according to the position they occupy in the real world either inside a store or an apartment depending on the used categorization (see Figure 1). Thereby we hope to exploit the users spatial memory and improve the performance of the menus [8, 29]. As with the linear menu representation, the depth and width of the spatial menu depends on the underlying categorization.
<figure><img src="image_2.png" /><figcaption>**Fig. 1.** Linear (left) and Spatial (right) representations, and product area relating to the sub-level “cabinet” under the top-level “kitchen”.</figcaption></figure>

## 3.2 Categorizations

The categorization determines the semantic structure of the menu and is usually structured hierarchically. In this paper, the categorizations are based on a three-level hierarchy (or menu depth) with top, sub and product levels. Overall, two different categories are investigated in this work: a traditional store- and an apartment-based categorization.

**Store-based** The traditional store-based categorization with different departments and themes, serves as the reference point for the evaluation as it represents the de-facto standard in current online shops [43]. The top-level categories of the hierarchy correspond to the product range that is typically separate departments, such as “milk & cheese” or “beverages”. The subordinate categories describe shelves in these delimited market areas, e.g. “cream cheese” or “lemonades”, followed by the product level as the lowest level (see Figure 1).

**Apartment-based** The apartment metaphor used in our approach uses the fact that users are familiar with the structure of an apartment and the items (products) placed in it based on everyday habits and experiences [1]. As with the store-based categorization, this is also based on a three-level hierarchy: rooms (e.g. kitchen), furniture (e.g. refrigerator), and product (e.g. mustard). In order to develop these categories and define the corresponding product assignments a pilot study was carried out to find out where users assume that these products should be located inside an apartment.
<figure><img src="image_3.png" /><figcaption>**Fig. 2.** The tree visualization representing the hierarchy of the apartment categories with room nodes on the first level and furniture nodes on the second level.</figcaption></figure>

# 4 Pilot Study

To create the needed reclassification of the selected products from store- to apartment-based categorization, we conducted a pilot study. This study is divided into two phases. In the first phase, we focus on the categorization and product allocation inside the Apartment metaphor. In the second phase, we aim to create two groups of products with the same size and approximately the same average level of difficulty (product search error rate) from the pool of the 36 selected products. Each product is then classified according to its average search error rate in order to ensure comparability of product data. This will serve as the logical basis for the main study design.

## 4.1 Phase 1: Categorization and Product Allocation

In total, 42 participants (20 female) between 18 and 58 years ($M = 31.12, SD = 12.35$) volunteered in the pilot study, which consisted of two sessions. In the first qualitative session, we conducted a semi-structured on-site interview and asked the participants where, i.e. in which room on or in which furniture, they store or would store each of the selected products, followed by a demographic questionnaire. Most participants lived in a two-room apartment ($M = 2.17, SD = 0.85$) (which do not include bathroom, kitchen or hallway) with an average of two inhabitants ($M = 2.38, SD = 1.19$). One third lived in a partnership ($N = 14$), followed by singles ($N = 10$), with parents / family ($N = 9$) or in a shared flat ($N = 9$). All of them have already shopped online, most of them at least once a month ($N = 34$). Information about the housing situation of the participants was gathered. More precisely, the room types belonging to the apartment as well as the product storage habits, i.e. which furniture is used as storage space, such as milk in the refrigerator or newspapers on the table. This was done in a semi-structured interview to form a set of room and furniture categories (top and sub level).
The result of the first session was a preliminary set of apartment locations (rooms and associated furniture), which form an essential part of the apartment categorization, as they form the basis for the product allocation. A total of seven room categories were considered, as these were named by well over half of the participants: bathroom (N = 41), kitchen (N = 41), bedroom (N = 41), hallway (N = 37), living room (N = 35), pantry/cellar (N = 32) and office (N = 30). After these there was very little agreement between participants, the next room in this list would be the garden with only 5 mentions. Therefore these rooms create our top-level for the categorization.

After defining the rooms used for product allocation, the furniture or places within these rooms had to be specified. The data collected by the interview was qualitative. Characteristic keywords were chosen to organize the answers given. Furniture that is very similar in use has been combined. For the example “bed linen” in the bedroom, the “built-in cupboard” (N = 1), the “linen cupboard” (N = 2), the “chest of drawers” (N = 2) and the “cupboard” (N = 11) were combined under the most frequently used keyword “cupboard”. Here is a complete overview of the rooms and associated furnitures (sub-level) in our categorization: **Bathroom**: cabinet, sink, sink cabinet, hook, toilet; **Bedroom**: bed, bedside table, cabinet, wardrobe; **Storage**: cabinet, washing machine; **Hallway**: cabinet, shoe cabinet; **Kitchen**: cabinet, drawer, fridge, sink, table, counter; **Living Room**: cabinet, computer, TV area, table; **Office**: cabinet, computer, desk.

In the second session, after we conducted and analyzed all 42 interviews, the same participants were asked to map the 36 selected products to one or multiple room-furniture pairs using an interactive web application. The web application consisted of three steps and was used to map the products to furniture and rooms (see Figure 2). The current question, *Where do you expect product "X"?* was displayed at the top of the screen. The current selection was listed left, as well as a next button to confirm the selection and to get to the next question. On the right, the apartment categories were visualized by an interactive hierarchical tree representation. The root represented the apartment itself, followed by the rooms as top-level and associated furniture as sub-level. This process supported multiple placement of products. In the main study, however, only one room-furniture pair was assigned to each product, namely the most frequently selected pair in this phase of the pilot study.

## 4.2 Phase 2: Product Groups

After selecting a suitable product set in the conceptual process, each product was assigned a level of difficulty to ensure better comparability. This was necessary to control learning effects within a categorization during the main study. The second phase took place in the local hypermarket, which provides us with the selected product data set, floor plan for the spatial store-based interface, and the departments and shelf names. Each participant (N = 30, 14 female) was provided with a worksheet, where the products had to be assigned to one of the store-based top categories. For each product, all incorrect answers were identified and statistical values were calculated for the error rates. Overall, the
average error rate over all products was 21.67% (SD = 27.20). This finding also shows that there is considerable potential for improvement, at least for this particular retailer, since expectations often do not correspond to reality. The average statistical values resulting from the short classification led to two comparable product groups being formed in the following main study in order to eliminate learning effects in relation to the different categories. Therefore, the total package of 36 products was divided into two groups of 18 products each with comparable error rates (A: ~ 21.1%, B: ~ 22.2%).

# 5 Main Study

We conducted an experiment to compare the developed apartment metaphor for online shopping with more common menu representations in respect to task performance (success rate, task completion time), user preferences (user experience, usability and task workload), and unmet needs. We evaluated two menu representations (*Linear* vs. *Spatial*) and categorizations (*Store* vs. *Apartment*). Our main hypotheses were defined as:

- $H_{1-1}$: The task can be performed more efficiently using *Apartment* categorization with regard to task performance.

- $H_{1-2}$: *Apartment* is preferred over *Store* categorization with regard to user preferences.

- $H_{2-1}$: The task can be performed more efficiently using *Spatial* representation with regard to task performance.

- $H_{2-2}$: *Spatial* is preferred over *Linear* representation with regard to user preferences.

## 5.1 Participants

For the main experiment, 24 different unpaid participants (12 female) were recruited from the university's campus; they were aged between 20 and 33 years ($M = 25.3, SD = 3.6$). Most of the participants live in a two room apartment ($Median = 2, M = 2.04, SD = 0.86$), which do not include bathroom, kitchen or hallway, with two inhabitants ($Median = 2$). Seven participants live with their parents/family (29.17%), six in a partnership or shared apartment (25%) and five live alone (20.83%). On a 7-point scale from never to daily with regard to online shopping frequency, most participants regularly purchase online, i.e. 62.5% at least several times per month, and all participants shop online at least once per month with computer/laptop ($N = 24$), compared to less frequently with tablets ($N = 7$) or smart-phones ($N = 14$).

## 5.2 Apparatus

The experiment was conducted on a MacBook Pro running Mac OS (10.11.6) connected to a 24-inch monitor. A standard wireless mouse was used as input device with medium speed settings. The software was displayed in Google Chrome
(v58.0.3029.110, 64-bit). HTML, CSS and JavaScript were used for the different menu interfaces in the prototype. Additionally, the JavaScript D3 library was used for data visualization purposes in the spatial menu condition. A database was set up using XAMPP (v7.0.5-0), data exchange was realized using PHP.

## 5.3 Evaluated Conditions

We evaluated two menu representations (linear, spatial) and two categorizations (store, apartment) to search products. In the linear menus, the menu items are arranged horizontally for all three vertical menu levels (top, sub and product level). In the spatial representations, items are arranged in a grid representing a virtual floor plan. Here, the participant clicks on the area with the corresponding text label to select a top-level category (see Figure 1). As a result, the corresponding furniture or shelf icons are displayed within the selected area. After clicking on a shelf or furniture, the associated products are then displayed in the product area below the menu area (see Figure 1). Although some products in the apartment concept should normally be placed in several positions per product, only one position was considered for each product in this main study in order to improve comparability of the conditions. This unique product placement refers to the most frequently mentioned placement from the pilot study.

## 5.4 Design

The experiment was a within-subjects design, with two independent variables with two levels each (representation: linear and spatial; categorization: store- and apartment-based) and five dependent variables related to the performance (task completion time, success rate) and preference of users (user experience, usability, workload). All representation and categorization conditions were counterbalanced using a Latin square. In order to eliminate learning effects concerning the different categorizations, the total set of 36 selected products was split into two comparable and equally difficult groups with 18 products respectively. Aside from training, this amounted to: 24 participants × 2 representations × 2 categorizations × 18 product searches = 1728 trials.

## 5.5 Task

During the main study, each participant performed a series of 18 search trials using a combination of the two representations (linear and spatial) and categorizations (store and apartment). The goal was to find and select a specific product and confirm the selection. The top-level categories were the departments of a local store for store-based and rooms for apartment-based categorization. The sub-level represented the shelves for store-based and furniture for apartment-based categorization (as developed in our pilot study). While the top- and sub-level visualizations differed depending on categorization and representation, the product level was displayed similar over all conditions by a product
image and text label. A trial was successfully completed when the correct target product was selected and confirmed within a time limit of 30 seconds, or counted as failed otherwise.

## 5.6 Procedure

After welcoming the participant by the experimenter, she was introduced by an informed consent form. Each participant used all four menu types in Latin square order to search for products in the prototypical online shop. Before using a particular type of menu, the participant was introduced to the tested condition by watching a demonstration video that showed an example search task step by step. Then a set of 18 search trials was carried out in random order. Before each trial, the name and image of the target product appeared for five seconds. Then the product had to be found in the three-level menu and selected by clicking on it and confirming the selection. After each trial set per menu type, three post-task questionnaires (UEQ [15], SUS [3], NASA TLX [9]) were filled out by the participant to collect user preference ratings. The entire process was then repeated for the other three menu types. Afterwards, a final post-study questionnaire was answered, which included demographic questions. In total, the main study lasted about 50-60 minutes.

## 5.7 Evaluation Metrics

We measured task performance in the form of objective data (task completion time, success rate) and collected data describing users' preference to the methods, including subjective feedback (user experience, workload, motion sickness, immersion).

**Task Performance** For each participant, we measured task completion time and success rate across the 18 product searches, in accordance with the common standards for product searches in online shops [17], as follows:

- **Task Completion Time (s)** was measured (in seconds) from when the countdown reaches zero to the product selection confirmation.

- **Success Rate (%)** was computed by calculating the number of correct product searches divided by all per set of trials for a tested menu interface.

**User Preference** We collected a variety of subjective feedback to assess *user experience* and *workload*, but also *usability*, important in online shop applications. Therefore, we used the following questionnaires:

- **User Experience Questionnaire (UEQ):** rated on a 7-point scale [15];
  The higher the score the better.

- **NASA Task Load Index (NASA TLX):** rated on a 21-point scale [9];
  The lower the rating the better.

- **System Usability Scale (SUS):** rated on a 5-point scale [3]; The higher
  the score the better.
# 6 Results

Throughout this results section and in the following discussion we use abbrevia-
tions, fill patterns and color indications for the two menu representations and cat-
egorizations we tested: **Linear (striped)**, **Spatial (solid)**, **Store-based (orange)**, **Apartment-based (blue)**. The results of the experiment were analyzed using IBM SPSS Statistics 25. For the data analysis, we calculated repeated mea-sures MANOVA and follow-up univariate ANOVAs. Using Wilks-Lambda statis-tic, there were significant differences for representations ($\Lambda$ = 0.13, $F$(6, 18) = 19.38, *p* < 0.01) and categorizations ($\Lambda$ = 0.03, $F$(6, 18) = 92.70, *p* < 0.01) for all tested dependent variables.

## 6.1 Task Performance

The task performance is measured quantitative through task completion time and success rate. These metrics indicate to what extent users are able to cope with the menu interfaces. They are computed per participant and condition as the average over the 18 trials.

**Success Rate** The success rate describes the ratio between the number of successful and the total number of product searches. A product search is considered successful if the correct product has been selected and confirmed within the maximum execution time of 30 seconds. *Spatial/Apartment* achieved the highest average success rate (*M* = 98.61, *SD* = 11.72), and *Linear/Store* the lowest (*M* = 69.44, *SD* = 46.12). Univariate ANOVAs showed significant differences with regard to success rate between the representations (*F*₁,₂₃ = 58.97, *p* < 0.01, *η*² = 0.72) with *Spatial* (*M* = 90.05, *SD* = 29.96) better than *Linear* (*M* = 80.44, *SD* = 39.69), as well as between the categorizations (*F*₁,₂₃ = 212.25, *p* < 0.01, *η*² = 0.90) with *Apartment* (*M* = 95.02, *SD* = 21.76) better than *Store* categorization (*M* = 75.46, *SD* = 43.06). An interaction effect for success rate could be shown between the two tested conditions (*F*₁,₂₃ = 4.38, *p* < 0.05, *η*² = 0.16).

**Task Completion Time** Task completion time was measured as the elapsed time in seconds to complete a single product search. The timer started when the countdown reaches zero and stopped automatically when the correct product has been selected and confirmed. In this analysis, we only included successful product searches. Furthermore, univariate ANOVAs showed significant differences for speed between representation ($F_{1,23} = 100.44, p < 0.01, \eta^2 = 0.81$) with *Spatial* (*M* = 9.47, *SD* = 5.28) faster than *Linear* (*M* = 10.38, *SD* = 5.77), and categorization ($F_{1,23} = 610.66, p < 0.01, \eta^2 = 0.97$) with *Apartment* (*M* = 8.79, *SD* = 4.82) faster than *Store* (*M* = 11.31, *SD* = 6.04).

## 6.2 User Preferences

**User Experience** We chose the UEQ [15] as an end-user questionnaire to measure user experience (UX) in a quick and straightforward way. On a scale be-
<figure><img src="image_4.png" /><figcaption>Fig. 3. Speed measurements (seconds) of successful trials.</figcaption></figure>

<figure><img src="image_5.png" /><figcaption>Fig. 4. User Experience Questionnaire (UEQ) results with respect to comparison benchmarks [31] (see shaded boxes). To make it easier to read, this figure shows a detail part between -1.5 and 2.5, while the original ranges between -3 and 3.</figcaption></figure>

tween -3 and 3 the overall UX, *Spatial/Apartment* achieved the highest score of 2.10 (*SD* = 0.53) on average, and *Linear/Store* the lowest (*M* = -0.76, *SD* = 1.15), with significant differences between representations (*F*<sub>1,23</sub> = 26.35, *p* < 0.01, *η*<sup>2</sup> = 0.53) and categorizations (*F*<sub>1,23</sub> = 99.20, *p* < 0.01, *η*<sup>2</sup> = 0.81) also differed significantly regarding the overall UX score. *Spatial* was rated higher with an average of 1.24 (*SD* = 1.30) than *Linear* (*M* = 0.20, *SD* = 1.50) with respect to representation, whereas *Apartment* was rated higher (*M* = 1.63, *SD* = 1.02) than *Store* (*M* = -0.19, *SD* = 1.33) with respect to categorization. However, the data was also subjected to a factor analysis, including the six UEQ factors. *Spatial/Apartment* outperformed all other menu interfaces across the UEQ subscales, even 'excellent' in terms of all subscales, followed by the *Linear/Apartment*, *Spatial/Store*, and finally *Linear/Store* (see Figure 4).
<figure><img src="image_6.png" /><figcaption>Fig. 5. The overall NASA TLX workload scores.</figcaption></figure>

**Usability** The SUS [3] is one of the most popular questionnaire for measuring attitudes toward system usability. It is a reliable and valid measure of perceived usability. *Spatial/Apartment* had the best score with 89.17 (SD = 8.16) on average, and *Linear/Store* (M = 50.73, SD = 26.66) the worst. Univariate ANOVAs pointed out a significance between the representations (*F*₁,₂₃ = 8.32, *p* < 0.01, *η*² = 0.27) and the categorizations (*F*₁,₂₃ = 41.44, *p* < 0.01, *η*² = 0.64). An interaction for usability between categorizations and representations could be found (*F*₁,₂₃ = 8.32, *p* < 0.01, *η*² = 0.27). Comparing the categorizations, *Apartment* had a higher average usability score (M = 85.05, SD = 13.95) than *Store* (M=56.35, SD=23.54). With regard to the representations, *Spatial* (M = 75.57, SD = 19.89) was higher than *Linear* (M = 65.83, SD = 26.93).

**Task Workload** The task workload of the tested menu representations and categorizations was assessed with NASA TLX [9]. On average, *Spatial/Apartment* was rated the best (M = 22.10, SD = 10.78) and *Linear/Store* (M = 61.04, SD = 18.69) the worst (see Figure 5). Univariate ANOVAs showed significant differences between the representations (*F*₁,₂₃ = 18.00, *p* < 0.01, *η*² = 0.44) and categorizations (*F*₁,₂₃ = 134.24, *p* < 0.01, *η*² = 0.85). *Spatial* was rated lower (M = 35.68, SD = 22.06) than *Linear* (M = 45.96, SD = 24.27), whereas *Apartment* achieved lower scores (M = 26.49, SD = 16.19) than *Store* (M = 55.15, SD = 21.17). We conducted a multivariate ANOVA with regard to these factors and found significant differences for all factors except physical demand between the four conditions, only for temporal demand, effort and frustration between the representations, and for all factors between the categorizations:

# 7 Discussion

## 7.1 Task Performance

The average success rate of about 99% of the spatial apartment-based menu is significantly higher than all other tested conditions, and contrasts with the
<table><caption>**Table 2.** NASA TLX contains six subscales (MD: Mental Demand, PD: Physical Demand, TD: Temporal Demand, PF: Performance, EF: Effort, FR: Frustration). The values refer to this format: ($F(x, 92) = .., p < .., \eta^2 = ..$), with $x = 3$ for the menu types and $x = 1$ for representations and categorizations.</caption><thead><tr><th></th><th>Menu Type</th><th>Representation</th><th>Categorization</th></tr></thead><tbody><tr><td>Mental Demand</td><td>(17.49, 0.01, 0.36)</td><td>-</td><td>(49.02, 0.01, 0.35)</td></tr><tr><td>Physical Demand</td><td>-</td><td>-</td><td>(4.70, 0.05, 0.05)</td></tr><tr><td>Temporal Demand</td><td>(17.34, 0.01, 0.36)</td><td>(4.41, 0.05, 0.05)</td><td>(47.51, 0.01, 0.34)</td></tr><tr><td>Performance</td><td>(11.01, 0.01, 0.26)</td><td>-</td><td>(29.01, 0.01, 0.24)</td></tr><tr><td>Effort</td><td>(15.13, 0.01, 0.33)</td><td>(4.73, 0.05, 0.05)</td><td>(40.65, 0.01, 0.31)</td></tr><tr><td>Frustration</td><td>(20.11, 0.01, 0.40)</td><td>(8.66, 0.01, 0.09)</td><td>(50.96, 0.01, 0.36)</td></tr></tbody></table>

linear store-based menu with the lowest rate of 69%. The speed results are based on successful product searches only and show that the task was executed faster with spatial apartment-based menus than with all other menus. This suggests that its intuitive categorization and spatial representation help the user to better understand the underlying information space. In addition, the visual cues in the spatial menus actually seem to facilitate the visual search process.

The clear differences in task performance indicate that a spatial grid-based menu in conjunction with an apartment-based categorization was more efficient than all other tested combinations, which proves $H_{1-1}$ and $H_{2-1}$. Since the menu with the worst average task performance is the commonly used menu type in today's online shops (see Section 2.3), our results show a remarkable potential for improvement.

## 7.2 User Preferences

The overall user experience results and highest ratings in all six UX subscales show that there is a clear advantage of the spatial apartment-based menu over all other tested menus. In particular, the significantly higher ratings of “Perspicuity”, “Efficiency” and “Dependability” speak for more understanding, user-friendliness and reliability. Here, too, the visual hints of the spatial representation seem to facilitate the search process. High ratings in “Attractiveness”, “Stimulation” and “Novelty” indicate that the more realistic and vivid presentation of the apartment categories seems to lead to a new and appealing experience.

Similar trends can be observed in the usability results. Here, too, the two apartment-based menus have achieved significantly better results. In addition, spatial menus achieved significantly higher usability values than linear menus within the respective categorization. Since values around 68 can already be interpreted as average to moderate<fnref n="5" />, the two apartment-based interfaces with an average score of 85.05 can be described as ‘excellent’. Whereas the spatial apartment-based menu even has a value of 89.17, which shows that comprehensibility is further supported by the illustrative character of the spatial representa-

<footnote n="5">⁵ www.measuringu.com/sus</footnote>
tion. Overall, the results clearly show that spatial apartment-based menus were
more usable than the other tested menus.

The task workload results show that store-based menus have scored more
than twice as many points (55.15) as the apartment categorization (26.49). This
indicates that the classification by rooms and furniture is cognitively less de-
manding than by product worlds and shelves. The spatial menus also achieved
significantly lower utilization than the linear menus. For the individual subscales
of the NASA TLX the spatial menu leads to significantly less effort, frustration
and mental demand, which indicates that the visual cues facilitate and acceler-
ate the orientation process. The apartment additionally minimizes the mental
demand, since no complex and strenuous considerations were necessary. Overall,
the new categorization and representation is less demanding and frustrating.

In summary, taking into account the results of user preference, it can be
stated that there is a significantly higher preference with regard to user experi-
ence, workload and usability for the spatial apartment-based menu. Thus $H_{1-2}$
and $H_{2-2}$ can be accepted, since they are fulfilled in all aspects considered.

## 7.3 Observations and Comments

The participants' comments also confirm the overall impression of the previously
discussed results. In the post-study questionnaire, the participants were explic-
itly asked for their opinion of the tested menus. Here, 23 out of 24 participants
preferred the spatial apartment-based menu, only one the linear apartment-based
menu. This choice was based on terms such as "intuitive", "easy", "entertaining",
"clear" or "fast". The results of a pair comparison also showed that the com-
bination of spatial apartment-based menus was preferred (98.61%), which faces
the least preferred linear store-based one (15.28%). This was also confirmed by
comments like "so hard" or "it will take a long time" for linear store-based and
"this was cool", "great" or "very intuitive" for spatial apartment-based after the
corresponding demonstration videos were shown. The majority of participants
would like this combination to be integrated into current online shops.

## 7.4 Limitations

The major drawback of this study is the limited amount of 36 products tested.
This applies in particular to the remarkably high ratings of preference ques-
tionnaires, which are often close to the optimal rating. Such 'excellent' results
rarely occur in practice and are probably due to the limited test conditions. The
scope and thus the number of products and categories of real online shops is
usually much larger and therefore more complex. It might well be the case that
the apartment metaphor does not scale with a large amount of products in its
current form. A larger number of products would imply more level of categoriza-
tions, e.g. different parts of furniture. A fridge should therefore be partitioned
into sublevels like door, vegetable drawer, and other layers. Each product can be
categorized into different product variations and brands. Our 3-level approach
has been chosen for a better overview and feasibility for our experiment. Our
concept of an online shop using the apartment metaphor aims at products, which
can be logically found in a standard apartment, e.g. no garage or garden prod-
ucts. Here, we would extend the apartment through e.g. a “home” metaphor. In
addition, the exact categorization might be subject of cultural change.

Furthermore, online stores have a wider range of functions. The implemented
prototype can therefore certainly not reflect the complexity of a real online shop,
but forms the basis and new insights for a rethinking in the area of menus in
online shops. In addition, the selected products are mainly based on a list of
frequently sought-after products from a particular market. Thus it cannot be
completely excluded that other products can be found more easily with the tradi-
tional categorization. Overall, expectations for preference evaluations and objec-
tive measurements in a fully functional online shop should be realistically lowered
overall. However, the clear significant differences show that spatial apartment-
based menus should still be preferred to the others.

8 Conclusion and Outlook

Especially when it comes to explorative setting in which a user tries to find
something from a menu, current online shops can be significantly improved. Even
though related work recommends to abandon linear and store-based menu inter-
faces [2, 30, 19], most current online shops are still employing these. Therefore,
we investigated two representations (Linear, Spatial) and two categorizations
(Store, Apartment) in an online shop prototype. The Apartment metaphor [1,
36] turned out to be an effective way to support consumers to quickly and eas-
ily understand and use the offered information in terms of filtering out desired
parts. Compared to the reference menu, the success rate was 42% higher and
led to 42% faster search times than with our stored-based concept. Spatial grid-
based menus performed significantly better than linear menus with a success
rate about 12% higher on average. Excellent usability and user experience rat-
ings indicate that spatial apartment-based interfaces increase understanding and
reliability. The workload results also indicate that the intuitive apartment cat-
egories are less complex and could lead to less frustration. In addition, 23 out
of 24 participants explicitly indicated that they preferred the apartment cate-
gories. Hence, our study confirmed previous approaches and demonstrated that
our approach leads to significant performance increases. While we do not claim
absolute generalizability for all online stores, this work highlights the potential
for improvement.

In summary, this work opens up a large new field of research for the real-
ization of menus in online shops. New methods for an enriched and facilitated
shopping experience have been introduced. While the new menu types usually
have the potential to improve menu interaction in online shops, further research
is needed to ensure that this result is maintained in a complete and comprehen-
sive shop system. We would extend the apartment through a Home metaphor
including garage or garden. Furthermore, hybrid representations could also solve
problems that might occur which a larger amount of products.
References

1. Adam, S., Mukasa, K.S., Breiner, K., Trapp, M.: An apartment-based metaphor for intuitive interaction with ambient assisted living applications. In: Proceedings of the 22Nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction - Volume 1. pp. 67–75. BCS-HCI ’08, British Computer Society, Swinton, UK, UK (2008), http://dl.acm.org/citation.cfm?id=1531514.1531524

2. Ahlström, D., Cockburn, A., Gutwin, C., Irani, P.: Why it’s quick to be square: Modelling new and existing hierarchical menu designs. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 1371–1380. CHI ’10, ACM, New York, NY, USA (2010). https://doi.org/10.1145/1753326.1753534, http://doi.acm.org/10.1145/1753326.1753534

3. Brooke, J.: Sus: A retrospective. J. Usability Studies 8(2), 29–40 (Feb 2013), http://dl.acm.org/citation.cfm?id=2817912.2817913

4. Cheng, H.I., Patterson, P.E.: Iconic hyperlinks on e-commerce websites. Applied Ergonomics 38(1), 65 – 69 (2007). https://doi.org/https://doi.org/10.1016/j.apergo.2006.01.007, http://www.sciencedirect.com/science/article/pii/S0003687006000214

5. Cockburn, A., Gutwin, C., Greenberg, S.: A predictive model of menu performance. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 627–636. CHI ’07, ACM, New York, NY, USA (2007). https://doi.org/10.1145/1240624.1240723, http://doi.acm.org/10.1145/1240624.1240723

6. Findlater, L., Moffatt, K., McGrenere, J., Dawson, J.: Ephemeral adaptation: The use of gradual onset to improve menu selection performance. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 1655–1664. CHI ’09, ACM, New York, NY, USA (2009). https://doi.org/10.1145/1518701.1518956, http://doi.acm.org/10.1145/1518701.1518956

7. Griffith, D.A.: An examination of the influences of store layout in on-line retailing. Journal of Business Research 58(10), 1391–1396 (2005), https://EconPapers.repec.org/RePEc:eee:jbrese:v:58:y:2005:i:10:p:1391-1396

8. Gutwin, C., Cockburn, A.: Improving list revisitation with listmaps. In: Proceedings of the Working Conference on Advanced Visual Interfaces. pp. 396–403. AVI ’06, ACM, New York, NY, USA (2006). https://doi.org/10.1145/1133265.1133347, http://doi.acm.org/10.1145/1133265.1133347

9. Hart, S.G., Stavenland, L.E.: Development of nasa-tlx (task load index): Results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (eds.) Human Mental Workload, chap. 7, pp. 139–183. Elsevier (1988), http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20000004342_1999205624.pdf

10. Hearst, M.A.: Clustering versus faceted categories for information exploration. Commun. ACM 49(4), 59–61 (Apr 2006). https://doi.org/10.1145/1121949.1121983, http://doi.acm.org/10.1145/1121949.1121983

11. Huang, Z., Benyoucef, M.: From e-commerce to social commerce: A close look at design features. Electronic Commerce Research and Applications 12(4), 246 – 259 (2013). https://doi.org/https://doi.org/10.1016/j.elerap.2012.12.003, http://www.sciencedirect.com/science/article/pii/S156742231200124X, social Commerce- Part 2
12. Katz, M.A., Byrne, M.D.: Effects of scent and breadth on use of site-specific search on e-commerce web sites. ACM Trans. Comput.-Hum. Interact. **10**(3), 198–220 (Sep 2003). https://doi.org/10.1145/937549.937551, http://doi.acm.org/10.1145/937549.937551

13. Kiger, J.I.: The depth/breadth trade-off in the design of menu-driven user interfaces. Int. J. Man-Mach. Stud. **20**(2), 201–213 (Mar 1984). https://doi.org/10.1016/S0020-7373(84)80018-8, http://dx.doi.org/10.1016/S0020-7373(84)80018-8

14. Larson, K., Czerwinski, M.: Web page design: Implications of memory, structure and scent for information retrieval. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 25–32. CHI ’98, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA (1998). https://doi.org/10.1145/274644.274649, http://dx.doi.org/10.1145/274644.274649

15. Laugwitz, B., Held, T., Schrepp, M.: Construction and evaluation of a user experience questionnaire. In: Symposium of the Austrian HCI and Usability Engineering Group. pp. 63–76. Springer (2008)

16. Lazar, J.: User-Centered Web Development: Theory into Practice. Jones and Bartlett Publishers, Inc., USA, 2nd edn. (2003)

17. MacKenzie, I.S.: Human-Computer Interaction: An Empirical Research Perspective. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1st edn. (2013)

18. Madu, C.N., Madu, A.A.: Dimensions of equality. International Journal of Quality & Reliability Management **19**(3), 246–258 (2002). https://doi.org/10.1108/02656710210415668

19. Meschtscherjakov, A., Reitberger, W., Lankes, M., Tscheligi, M.: Enhanced shopping: A dynamic map in a retail store. In: Proceedings of the 10th International Conference on Ubiquitous Computing. pp. 336–339. UbiComp ’08, ACM, New York, NY, USA (2008). https://doi.org/10.1145/1409635.1409680, http://doi.acm.org/10.1145/1409635.1409680

20. Miller, C.S., Remington, R.W.: Modeling information navigation: Implications for information architecture. Hum.-Comput. Interact. **19**(3), 225–271 (Sep 2004)

21. Miller, D.P.: The depth/breadth tradeoff in hierarchical computer menus. Proceedings of the Human Factors Society Annual Meeting **25**(1), 296–300 (1981). https://doi.org/10.1177/107118138102500179

22. Mitchell, J., Shneiderman, B.: Dynamic versus static menus: An exploratory comparison. SIGCHI Bull. **20**(4), 33–37 (Apr 1989). https://doi.org/10.1145/67243.67247, http://doi.acm.org/10.1145/67243.67247

23. Moagr-Poladian, S., Dumitrescu, G.C., Tnase, I.A.: Retail e-Commerce (E-tail) evolution, characteristics and perspectives in China, the USA and Europe. Global Economic Observer **5**(1) (June 2017), https://ideas.repec.org/a/ntu/ntugeo/vol5-iss1-17-167.html

24. Murano, D.P., Sander, M.: User interface menu design performance and user preferences: A review and ways forward. International Journal of Advanced Computer Science and Applications **7**(4), 355–361 (2016). https://doi.org/10.14569/IJACSA.2016.070447, http://dx.doi.org/10.14569/IJACSA.2016.070447

25. Norman, K.L.: Better design of menu selection systems through cognitive psychology and human factors. Human Factors **50**(3), 556–559 (2008). https://doi.org/10.1518/001872008X288411, pMID: 18689067

26. Petz, G., Greiner, A.: First in search – how to optimize search results in e-commerce web shops. In: Nah, F.F.H. (ed.) HCI in Business. pp. 566–574. Springer International Publishing, Cham (2014)
27. Plechawska-Wojcik, M.: Heuristic Evaluation and User Experience Assessment of Online Shopping Portals Using Cognitive Walkthrough and Expert Method, pp. 467–475. Human Capital without Borders: Knowledge and Learning for Quality of Life; Proceedings of the Management, Knowledge and Learning International Conference 2014, ToKnowPress (2014)

28. Resnick, M.L., Sanchez, J.: Effects of organizational scheme and labeling on task performance in product-centered and user-centered retail web sites. Human Factors 46(1), 104–117 (2004). https://doi.org/10.1518/hfes.46.1.104.30390, pMID: 15151158

29. Robertson, G., Czerwinski, M., Larson, K., Robbins, D.C., Thiel, D., van Dantzich, M.: Data mountain: Using spatial memory for document management. In: Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology. pp. 153–162. UIST ’98, ACM, New York, NY, USA (1998). https://doi.org/10.1145/288392.288596, http://doi.acm.org/10.1145/288392.288596

30. Scarr, J., Cockburn, A., Gutwin, C., Bunt, A.: Improving command selection with commandmaps. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems pp. 257–266 (2012). https://doi.org/10.1145/2207676.2207713

31. Schrepp, M., Hinderks, A., Thomaschewski, J.: Construction of a benchmark for the user experience questionnaire (ueq). International Journal of Interactive Multimedia and Artificial Intelligence 4(4), 40–44 (06/2017 2017). https://doi.org/10.9781/ijimai.2017.445

32. Schwartz, J.P., Norman, K.L.: The importance of item distinctiveness on performance using a menu selection system. Behaviour & Information Technology 5(2), 173–182 (1986). https://doi.org/10.1080/01449298608914510

33. Sears, A., Shneiderman, B.: Split menus: Effectively using selection frequency to organize menus. ACM Trans. Comput.-Hum. Act. 1(1), 27–51 (Mar 1994). https://doi.org/10.1145/174630.174632, http://doi.acm.org/10.1145/174630.174632

34. Shim, S., Eastlick, M.A., Lotz, S.L., Warrington, P.: An online prepurchase intentions model: The role of intention to search: Best overall paper awardthe sixth triennial ams/acra retailing conference, 200011 decision made by a panel of journal of retailing editorial board members. Journal of Retailing 77(3), 397 – 416 (2001). https://doi.org/10.1016/S0022-4359(01)00051-3, http://www.sciencedirect.com/science/article/pii/S0022435901000513

35. Speicher, M., Cucerca, S., Krüger, A.: Vrshop: A mobile interactive virtual reality shopping environment combining the benefits of on- and offline shopping. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1(3), 102:1–102:31 (Sep 2017). https://doi.org/10.1145/3130967, http://doi.acm.org/10.1145/3130967

36. Speicher, M., Hell, P., Daiber, F., Simeone, A., Krüger, A.: A virtual reality shopping experience using the apartment metaphor. In: Proceedings of the 2018 International Conference on Advanced Visual Interfaces. pp. 17:1–17:9. AVI ’18, ACM, New York, NY, USA (2018). https://doi.org/10.1145/3206505.3206518, http://doi.acm.org/10.1145/3206505.3206518

37. Tsandilas, T., schraefel, m.c.: Bubbling menus: A selective mechanism for accessing hierarchical drop-down menus. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 1195–1204. CHI ’07, ACM, New York, NY, USA (2007). https://doi.org/10.1145/1240624.1240806, http://doi.acm.org/10.1145/1240624.1240806
38. Tuch, A.N., Roth, S.P., Hornbæk, K., Opwis, K., Bargas-Avila, J.A.: Is beautiful really usable? toward understanding the relation between usability, aesthetics, and affect in hci. Comput. Hum. Behav. **28**(5), 1596–1607 (Sep 2012). https://doi.org/10.1016/j.chb.2012.03.024, http://dx.doi.org/10.1016/j.chb.2012.03.024

39. Vrechopoulos, A.P., O'Keefe, R.M., Doukidis, G.I., Siomkos, G.J.: Virtual store layout: an experimental comparison in the context of grocery retail. Journal of Retailing **80**(1), 13 – 22 (2004). https://doi.org/10.1016/j.jretai.2004.01.006, http://www.sciencedirect.com/science/article/pii/S002243590400003X

40. Wallace, D.F., Anderson, N.S., Shneiderman, B.: Time stress effects on two menu selection systems. Proceedings of the Human Factors Society Annual Meeting **31**(7), 727–731 (1987). https://doi.org/10.1177/154193128703100708

41. Wigand, R.T., Benjamin, R.I., Birkland, J.L.H.: Web 2.0 and beyond: Implications for electronic commerce. In: Proceedings of the 10th International Conference on Electronic Commerce. pp. 7:1–7:5. ICEC ’08, ACM, New York, NY, USA (2008). https://doi.org/10.1145/1409540.1409550, http://doi.acm.org/10.1145/1409540.1409550

42. Zaphiris, P., Kurniawan, S.H., Ellis, R.D.: Age related differences and the depth vs. breadth tradeoff in hierarchical online information systems. In: Proceedings of the User Interfaces for All 7th International Conference on Universal Access: Theoretical Perspectives, Practice, and Experience. pp. 23–42. ERCIM’02, Springer-Verlag, Berlin, Heidelberg (2003), http://dl.acm.org/citation.cfm?id=1765426.1765429

43. Zhang, F., Lin, S., Li, X., Shuai, Y., Jiang, H., Yao, C., Ying, F., Gao, F.: Navigation configuration and placement influences the visual search efficiency and preference. In: Proceedings of the 26th International Conference on World Wide Web Companion. pp. 871–872. WWW ’17 Companion, International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland (2017). https://doi.org/10.1145/3041021.3054236, https://doi.org/10.1145/3041021.3054236