Towards Collaboration Translucence: Giving Meaning to Multimodal Group Data
Channel: Simon Buckingham Shum
Date: 28/05/2019

University of Sydney, School of Computer Science  •  28th May 2019
Invited Talk, Computer-Human Adapted Interaction Research Group

Vanessa Echeverria, Roberto Martinez-Maldonado & Simon Buckingham Shum

Connected Intelligence Centre, University of Technology Sydney, AUS

@vanechev @RobertoResearch @sbuckshum

Extended presentation based on:

Echeverria, V., Martinez-Maldonado, R. and Buckingham Shum, S. (2019). Towards Collaboration Translucence: Giving Meaning to Multimodal Group Data. In Proceedings of ACM CHI Conference (CHI’19). ACM, New York, NY, USA, Paper 39, 1-16. https://doi.org/10.1145/3290605.3300269 

Open Access reprint: http://simon.buckinghamshum.net/wp-content/uploads/2019/02/CollabTranslucence_CHI2019.pdf

ABSTRACT

Collocated, face-to-face teamwork remains a pervasive mode of working, which is hard to replicate online. Team members’ embodied, multimodal interaction with each other and artefacts has been studied by researchers, but due to its complexity, has remained opaque to automated analysis. However, the ready availability of sensors makes it increasingly affordable to instrument work spaces to study teamwork and groupwork. The possibility of visualising key aspects of a collaboration has huge potential for both academic and professional learning, but a frontline challenge is the enrichment of quantitative data streams with the qualitative insights needed to make sense of them. In response, we introduce the concept of collaboration translucence, an approach to make visible selected features of group activity. This is grounded both theoretically (in the physical, epistemic, social and affective dimensions of group activity), and contextually (using domain-specific concepts). We illustrate the approach from the automated analysis of healthcare simulations to train nurses, generating four visual proxies that fuse multimodal data into higher order patterns.