CASE Study Use of AI Smart Speaker 3rd year  Economic major students SNS is beneficial for English Education.
• Amazon Alexa and Google home mini • 10-month period (Apr 2019 – Jan 2020) • Used at home • Encourage to use daily • Pre vs. Post TOEIC • Pre vs. Post OPIc S • Surveyed Pedagogy (n=23) 4.12.2019~1.21.2020. • Al Speakers, many applications • Recorded short movie clips of their learning experiences which were uploaded to Facebook. • Kept written diaries with their observations about the contents and duration of their studies.
• Best Teacher • Travel English • Let’s play around with English (Interactive) • BBC/CNN news. • TOEIC practice • Let's speak (Interactive) • And so on •  30 lessons (3 hours / 30 weeks=90 hours) •  CaLabo EX  CALL System  PC •  World views Study (TED Talks + articles) •  Alister McGrath book (Meaning of life, CS. Lewis vs. Richard Dawkins) •  Special lectures about CQ (4 times per year, Professor Weakly) •  Interaction with CCC members (4 times/2+2)  Face to face, •  Preparation for Group Presentations for Singapore (First semester) •  Interaction and Presentations (National University of Singapore, 10 days) •  PBL Group project presentation + Al project  (2 times) iPads +PC
Outside of the class Classroom Crowd Learning Environments: Flipped learning: CBL(Challenge-based Learning), PBL(Project-based Learning) , TBL (Task-based Learning), Input: Outside of the class • AI, Web, Digital text; iPad, Smartphone Output: Inside the class + ZOOM • Presentation, Discussion, Interaction,
■ Strongly Agree     ■ Agree     ■ Neutral     ■ Disagree     ■ Strongly Disagree
■ Strongly Agree     ■ Agree      ■ Neutral     ■ Disagree     ■ Strongly Disagree
■ Very useful ■ Somewhat useful ■ Not useful ■ Not much useful ■ Neutral
■ Somewhat useful ■ Very useful ■ Not useful ■ Neutral ■ Not much useful • Analysis Higher Order Thinking Skills • Evaluation • Integration • Creation Did you learn 21st century skills and the importance of AI through this seminar? 97% (N=31) ■ Somewhat agree ■ Totally agree ■ Neutral ■ Not agree ■ Not much agree
■ Totally agree     ■ Agree     ■ Netural     ■ Not agree     ■ Not much agree Assessment with a smart phone during a presentation.
x sh @ o ③ o Submit Total: 0 / 30 lは、く、などな西  o H  9  9  C II PeerEval Assessment Comments about the use of PeerEval ➤It is easy to reflect on presentation to improve weakness and quickly to get the mean score among evaluators. > Quick feedback
• Pre-test  vs Post-test (ATR CALL Brix, TOEIC) • Assess presentation with PeerEval • MPEG-4 movie product (PowerPoint slides + sound movie) • Presentation, Reflection • Engagement

■ Most useful    ■ Useful    ■ Neutral    ■ Not so useful    ■ Not at all
The Results of  TOEIC and OPIC Speaking Test Results of TOEIC (n=23) 4.11.2019 ~ 1.21.2020 Pre TOEIC vs. Post TOEIC 461(SD,136) ～ 676(SD,144) + 215 points CEFR A2 (Used be an improvement of about 150 points) Pre Opic vs. Post OPIc (Full score=8) 3.91(SD,0.95) ~ 4.74(SD,1.25) + 0.83 (p-value = 0.0005771) p < .05
Pre-listening test vs Post-listening test t = -7.0591, df = 22, p-value = 4.413e-07  P<0.05 235.65 (SD68.73) →     359.65 (SD85.48)  123.5 points Basic statistics $Data.1 n mean sd median trimmed mad min max range skew kurtosis se 23 235.65 68.73    230  233.16 74.13 120 370   250 0.35    -0.91 14.33 $Data.2 n mean sd median trimmed mad min max range skew kurtosis se 23 359.13 85.48    395  367.37 74.13 160 460   300 -0.81    -0.48 17.82 $Correlation [1] 0.4248973
t = -5.2646, df = 22, p-value = 2.783e-05  P<0.05 225.65 (SD94.34)  → 317.17 (SD74.02)  + 91.5 points • Pre-test reading • n   mean    sd median trimmed   mad min max range skew kurtosis    se •  23 225.65 94.34    210  221.05 96.37  70 445   375 0.49    -0.62 19.67 • Post-test reading • n mean sd median trimmed mad min max range skew kurtosis se •  23 317.17 74.02    350  323.42 37.06 145 410   265 -0.91    -0.41 15.43 • $Correlation • [1] 0.5318918
Opic Speaking Test
5.5
2019.4.12
2020.1.12
Changes of the Individual data(n=23) 19 students progressed. 4 remained the same.
Data 1
Questionnaire Use of Al
Conversations on daily topics Music, news, weather Setting alarm and timer Linking to TV
easy to operate can practice using it anytime improves listening and conversation skills interacts with me like a conversation partner improves pronunciation functions as a dictionary/encyclopedia To improve vocabulary by asking for definitions of words
Conversation & listening everyday conversation opportunity to converse in English about daily life topics Pronunciation uses standard pronunciation listening to news developed awareness of correct pronunciation having pronunciation understood instilled confidence
■ Very useful   ■ Somewhat useful   ■ Neutral   ■ Not useful ls it useful to use Al speaker for listening ? 87%  January 21, 2020.
■ Useful   ■ Not useful

◾ Very useful    ◾ Somewhat useful    ◾ Netural    ◾ Not much useful    ◾ Not at all

• (S1) I could set up an AI speaker to a particular time to make a study a part of my daily routine to listen to the news. Alexa has many useful applications to study English. • (S2) An AI speaker helped me to improve my listening comprehension and speaking skills in English. It was much easier to study, and I was more motivated to study English with this AI speaker. I was more exposed to listening to English, which was the significant advantage of using an Al speaker. Implication Students prefer to use AI to study English. 2. Al will be their English interaction partner or help with the assignments. 3.  Al will be integrated to Future job.
▷How effective is the use of AI in teaching EFL in Japan? Useful for learning Speaking and Listening.
Integration