# Virtual Reality as a Reflection Technique for Public Speaking Training
## 5 Evaluation
### Outcome Measurements  
One of the aims of this experiment was to explore the benefits for presenters with different personality traits from the training.  
The benefits of a reflection method for public speaking are considered in mainly three parts--changes of anxiety for public speaking, changes of subjective impression and improvement of public speaking skills. The attention pattern in the playback and the willingness of using this system were also measured as the supplement for the performance of the method, since the attention part could lead to the result of reflection and the willingness will lead to the dropout rate of the training.  
The questionnaires used for this experiment are as follows. By using these questionnaires, the personal characteristics for presenter and training indicators of the training method were measured.  
**Anxiety(Anx)**: To measure the changes of anxiety around public speaking, the PRCS [32; 33] was employed. It is a 12-item questionnaire that evaluates fear on a scale of 1 to 10.  
Figure 6: Experimental conditions for the checking participants’ own presentation. (**a**) Condition 1: Recorded video on a PC monitor. (**b**) Condition 2: Avatar constructed on the recorded information on the PC monitor. (**c**) Condition 3: Avatar constructed on the recorded information with a head-mounted display.  
Presentation quality by self(SQu)To measure changes of subjective impression on presentation performance, the PSCR score introduced in [16] considered 11 questions that focus on the content, voice, and body movement in order to provide self-assessment of the presentation quality. Four of the questions were related to the preparation and organization of the presentation material, but these four questions were not used since the presentation material was prepared in advance. Besides the PSCR score, a 100-point scale was added to survey the overall impression of the presentation.Presentation quality by others(OQu)The improvement of public speaking skills was measured according to the evaluators, so the PSCR score was also used as an index for the assessment by the evaluators. Two of the three evaluators who were randomly assigned made the evaluation immediately after they finished listening to the presentation. Although the evaluators were non-experts on the presentation content, the PSCR was designed such that the users can perform objective and quantitative assessments even for non-experts. Corresponding to SQu, there was a 100-point scale for overall impression of the presentation as well. The average of the evaluators' scores was used as an indicator.Degree of concern(DoC) for each part in the playbackA mark sheet with 11 items was used to identify the areas that received attention during the playback. These items include: (1) vocal performance (i.e., pitch, loudness), (2) pauses, (3) meaningless actions and words, (4) vocabulary, (5) topic and content, (6) stance, (7) hand gestures, (8) eye contact, (9) facial expression, (10) dress, and (11) foot jittering. The participants were asked to score each item on a 20-point scale to indicate the DoC.Willingness of playback(Wil)Participants were asked to score the level of willingness to use the playback method in each condition based on a 5-point scale (1: strongly disagree, 5: strongly agree).