<figure><img src="image_1.png" /></figure>

HAL
open science

# Learning HCI and InfoVis in the Open

Erik Duval, Gonzalo Parra, Jose Luis Santos, Sam Agten, Sven Charleer, Joris

Klerkx

► To cite this version:

Erik Duval, Gonzalo Parra, Jose Luis Santos, Sam Agten, Sven Charleer, et al. Learning HCI and InfoVis in the Open. 8th Workshop on Human-Computer Interaction and Visualization (HCIV), Sep 2011, Lisbon, Portugal. pp.8-16, 10.1007/978-3-642-54894-9_2. hal-01414648

HAL Id: hal-01414648

https://hal.science/hal-01414648

Submitted on 12 Dec 2016

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_2.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# Learning HCI and InfoVis in the Open

Erik Duval, Gonzalo Parra, Jose Luis Santos, Sam Agten, Sven Charleer, Joris Klerkx

KU Leuven, University of Leuven, Belgium
erik.duval@cs.kuleuven.be
http://erikduval.wordpress.com

**Abstract.** In this paper, we report on our experiences with novel learning strategies for HCI and Information Visualisation, in the context of a computer science master curriculum. What sets our experiences somewhat apart is the focus on openness. This includes the use of Open Educational Resources (OER), as well as open communication between the students, the professor and the general public, through web2.0 tools like blogs, wikis, Facebook and Twitter.

## 1 Introduction

The work reported here is part of a strong trend towards more open forms of learning. In this context, 'open' can mean many things, including

- open standards that realise interoperability between the different components of a learning infrastructure at the technical level [4];

- open source implementations of such components that enable developers to inspect and modify the source code [11];

- open content that can be shared, repurposed and reused freely - often called 'open educational resources' or OER [5];

- open learning where also the learning activities are more openly shared [7].

We focus on open collaborative learning activities, because we believe that providing students with authentic and realistic learning environments is key to fighting the feeling of alienation and the lack of motivation that characterises so much of formal learning. Providing students with open environments where they work on realistic problems in a dialogue with the wider world is key to addressing this fundamental problem.

Moreover, we position our work in the context of 21st century competencies (information literacy, creativity & innovation, collaboration, problem solving, communication and responsible citizenship), rather than drill-and-practice repetitive fact memorisation or very closed problem solving as is more typical in many university courses. These competencies comprise both skills [6] and dispositions to learn [2]. Basically, the idea is that we should teach students to solve problems we don't know using technologies we don't know, especially in technology oriented domains like computer science where the domain continues to evolve at increasing speed under the influence of Moore's law [9].
A currently very active instantiation of the open learning idea are MOOC's or
'Massively Open Online Courses' that enable anyone to take courses anywhere[1].
As often well-known prestigious universities organised themselves in networks of
providers of such MOOC's and their offerings attract regularly many tens of
thousands of learners, the concept of MOOC's has received substantial media
coverage [10]. Our course is similar but it is not massive by any meaning of the
word: we typically have about 30 students. Our course is open though, but in a
different way than MOOC's. Whereas the openness in the latter mainly relates
to the low barrier for people to register, we focus more on making students work
together and communicate with each other and the team in an open way, through
public blogs and Twitter. Our courses are typically only partly "on-line": we do
use blogs and wikis and Twitter to communicate, but we also do face-to-face
studio sessions throughout the semester.

## 2 The courses

In concrete terms, we present here how we have been teaching courses on Human-
Computer Interaction (HCI) and, more recently, Information Visualisation (In-
foVis) to computer science engineering students at the University of Leuven in
Belgium. Typically, these courses are taken by twenty-five to thirty-five master
students in engineering, most of them specialising in computer science. They are
optional courses for students with a strong technological focus and background.
The HCI course is their first course that focuses on user oriented aspects rather
than on technical programming skills.

As such, the main goal of the courses is to make the students change their
perspective on how software is evaluated - not from a technical point of view, but
focused on how it impacts the user experience. Indeed, evaluation is the main
topic of the course: we start with the evaluation of an existing software product
(over the years, we have evaluated Mendeley, Google Plus, Pinterest, and others).
After this first activity, we start cycles of iterative development, going from
brainstorming sessions over user scenario development and paper prototyping to
more and more functional digital prototypes and, finally a release 'in the wild',
i.e. to the general public. Throughout these activities, we continuously evaluate
intermediate versions and the students are expected to document the outcomes
of their evaluations and how these outcomes dictate their iterative development
cycles.

## 3 set-up

The open nature of the course is reflected in the choice of tools that we rely on
for organising the learning effort:

- Rather than an institutional Learning Management System (LMS) like Black-
  board or Moodle, we use a wiki as the main 'landing page' of the course (see
  Figure 1). This is important, as an LMS environment is typically set up and
<figure><img src="image_3.png" /><figcaption>Fig. 1. The course wiki</figcaption></figure>
under the control of the central institutional services. We replace this environment with a tool that is under complete control of the students: initially, the wiki page only contains a title and empty placeholder text. The clear message, although implicit, is that students are expected to take responsibility for their own learning [3].

- Students typically work in groups of three and communicate with the other groups and teaching staff through public blogs. They are explicitly asked to not only read the blogs of the other groups, but also to comment on the posts of other groups. The intent is to create a community of practice, where learning takes place in an open spirit of collaboration and communication [12].

- Whereas the blogs are intended for more substantial posts and comments on these posts, we rely on Twitter hashtags for more ephemeral messages that create a 'pulse of the course' and support continuous awareness of ongoing activities in the course (see Figure 2).

The result is that the on-line communication happens in a 'class without walls': external people can follow and post to the Twitter stream, subscribe to the blog posts, and leave comments on the student blogs. Although this kind of external input is a small percentage of the overall activity (see also table 1), it contributes significantly to the authentic nature of the course activities: in the words of the students, 'real people' (i.e. not the teaching staff or peer students) take an interest in what they post! One recent example is a reaction from a representative of a software tool, who commented on one of the student blogs to help them with problems they experienced with the tool.

A more inspiring example is that of figure 3: in reaction to evaluations that the students logged about a bibliographic reference manager (mendeley, http://mendeley.com), one of the founders of the company commented on these evaluations. For the students, it is quite motivating to discover that their comments are not only read by the course staff and that these comments may actually serve another purpose than passing an exam or getting a degree...

<table><caption>**Table 1.** Statistics on the 2013 HCI course</caption><tr><td>number of students</td><td>26</td></tr><tr><td>number of blog posts</td><td>50</td></tr><tr><td>number of blog comments by students</td><td>207</td></tr><tr><td>number of blog comments by staff</td><td>57</td></tr><tr><td>number of blog comments by outsiders</td><td>12</td></tr></table>

Another variation on the same theme of openness is participation in 'hackatons', i.e. intensive events where teams design and develop software over a period of a few hours to a few days. In the Information Visualisation course, we participated in the '2012 Visualizing Global Marathon' (http://visualizing.org/
<figure><img src="image_4.png" /><figcaption>Fig. 2. The course blog comments and Twitter stream</figcaption></figure>
<figure><img src="image_5.png" /><figcaption>Fig. 3. An inspiring reaction from an 'outsider'</figcaption></figure>
marathon2012/), an event from Friday evening until Sunday midnight, with locations across the world. Students were given three data sets at the start and could participate in video conferences with experts on visualisation. A Twitter hashtag organised Twitter messages. After the event, a jury evaluated the results. Actually, some of the teaching staff also participated in the hackaton and one of them, Till Nagel, was awarded a prize for his work (see Figure 4). Again, this creates an open atmosphere in which students work not only under supervision of the teaching staff on a project that they hand in, but rather work with staff in a global community of students, staff and experts, in an intensive setting where friendly competition motivates but doesn't prevent collaboration!

<figure><img src="image_6.png" /><figcaption>Fig. 4. A winning hackaton entry by Till Nagel</figcaption></figure>
4 Issues

Such an open approach is not without its own issues. We list some of the more
important ones below:

- The number and diversity of interactions (Twitter, blog posts and comments, wiki edits, ...) can be a bit overwhelming. This can be problematic for students and staff alike. However, we believe that coping with this kind of 'information overload' (or rather 'filter failure' when this becomes a problem [13]) is an important 21st century meta-skill in itself and that it is actually useful that students acquire this skill as well. Moreover, we also research the use of learning analytics dashboard applications [14,15] that enable staff and students to be aware of, reflect on, make sense of and act on what is going on.

- There are obvious concerns around privacy and 'trusted environments' when learning takes place in this open way: students are sometimes concerned that potential future employers will be able to find out about the mistakes they made in class. On the other hand, our perceptions of what is appropriate to share and what should be private are shifting as technology develops [8]. More importantly, we believe that it is also valuable that students learn to act in public and engage with an external audience, the more so as this is a way to realise a more authentic learning context, as we have argued above.

- There is, of course, a certain overhead involved in the social interactions among students, and between students and the general public. Although we have already mentioned that we believe that mastering social interaction is a useful skill in its own right, there is still a question whether the added effort actually results in more learning - i.e. less time required overall, or better learning outcomes. In fact, grading for these courses is based on the project outcome: in that sense, students are not rewarded directly for social interaction and collaboration. On the other hand, by making use of the opportunities for interaction, students can receive more feedback about progress on their projects as they proceed, which should result in increased motivation and a higher quality outcome, and thus a higher grade. However, carefully evaluating the impact of the open approach on the learning outcome remains tricky as it is difficult to isolate the effect of our approach from all the other variables that affect student results.

- It is unclear how well this approach would scale from our current group of around 30 students to hundreds or the many thousands of students in MOOC's. On the one hand, as mentioned above, students already now report feeling a bit overwhelmed. Scaling up the courses risks making this problem much more serious. On the other hand, it would be possible to make students interact intensively with just a small subset of a large group. And to channel the contributions from outsiders, so that they would still reach all of the students, unless the participation from outsiders also increases with the student numbers, and we can also partition their contributions to subsets of students. Yet, how to scale up without turning the experience into a set of isolated mini-courses for each subset of students remains unclear.
# 5 Conclusion

In this paper, we have presented our work on teaching Human-Computer Interaction and Information Visualisation in an open way. Our work is part of a broader evolution towards more open software, content and learning in general. Our basic premise is that a more open approach prepares students better for a 21st century professional career and life in general and that the more authentic context for learning improves motivation and thus increases the likelihood of positive learning outcomes. Although this approach can at times be challenging for students and staff alike, we believe that this openness is essential for deeper authentic learning.

# References

1. I. de Waard, S. Abajian, M. S. Gallagher, R. Hogue, N. Keskin, A. Koutropoulos, and O. C. Rodriguez. Using mlearning and moocs to understand chaos, emergence, and complexity in education. *The International Review of Research in Open and Distance Learning*, 12(7):94–115, 2011.

2. R. Deakin Crick. Assessment in schools - dispositions. In B. McGaw, P. Peterson, and E. Baker, editors, *The International Encyclopedia of Education*. Elsevier, 2009.

3. J. Dron. Social Software and the Emergence of Control. In *Advanced Learning Technologies, 2006. Sixth International Conference on*, pages 904–908, 2006.

4. E. Duval and K. Verbert. On the role of technical standards for learning technologies. *IEEE Transactions on Learning Technologies*, 1(4):229–234, Oct. 2008.

5. E. Duval and D. Wiley. Guest Editorial : Open Educational Resources. *IEEE Transactions on Learning Technologies*, 3(2):83–84, 2010.

6. P. Griffin. *Assessment and teaching of 21st century skills*. Springer, 2012.

7. T. Iiyoshi and M. S. V. Kumar, editors. *Opening Up Education*. MIT Press, 2008.

8. J. Jarvis. *Public Parts: How Sharing in the Digital Age Improves the Way We Work and Live*. Simon & Schuster, 2011.

9. R. Kurzweil. *The singularity is near: When humans transcend biology*. Penguin books, 2005.

10. L. Pappano. The year of the mooc. *The New York Times*, 4, 2012.

11. E. Raymond. The cathedral and the bazaar. *Knowledge, Technology & Policy*, 12(3):23–49, 1999.

12. H. Rheingold. *The virtual community: Homesteading on the electronic frontier*. MIT Press, 2000.

13. C. Shirky. *Here Comes Everybody: The Power of Organizing Without Organizations*. Penguin Press, 2008.

14. D. Suthers, K. Verbert, E. Duval, and X. Ochoa, editors. *LAK '13: Proceedings of the Third International Conference on Learning Analytics and Knowledge*, New York, NY, USA, 2013. ACM.

15. K. Verbert, E. Duval, J. Klerkx, S. Govaerts, and J. L. Santos. Learning analytics dashboard applications. *American Behavioral Scientist*, In press:10 pages, 2013.