The Multimodal Tutor - Daniele Di Mitri's PhD Defence - Open University of The Netherlands
Channel: Daniele Di Mitri
Date: 08/09/2020

Daniele Di Mitri's PhD Defence took place at the Open University of The Netherlands on the 4th September 2020

Abstract

This doctoral thesis describes the journey of ideation, prototyping and empirical testing of the Multimodal Tutor}, a system designed for providing digital feedback that supports psychomotor skills acquisition using learning and multimodal data capturing. The feedback is given in real-time with a machine-driven assessment of the learner's task execution. The predictions are tailored by supervised machine learning models trained with human-annotated samples. The main contributions of this thesis are a literature survey on multimodal data for learning, a conceptual model (the Multimodal Learning Analytics Model), a technological framework (the Multimodal Pipeline), a data annotation tool (the Visual Inspection Tool) and a case study in Cardiopulmonary Resuscitation training (CPR Tutor). The CPR Tutor generates real-time, adaptive feedback using kinematic and myographic data and neural networks. 

Presentation
https://www.slideshare.net/dnldimitri/the-multimodal-tutor-presentation-phd-defence

Link to the PhD Thesis manuscript 
https://research.ou.nl/en/publications/the-multimodal-tutor-adaptive-feedback-from-multimodal-experience