Riku Arakawa

C.V. - 1

RIKU ARAKAWA
Email: riku.arakawa1996@gmail.com
Web: https://rikky0611.github.io/

Research Direction: Using Imperfect Sensing for Reliable Health AssistantI develop adaptable, intelligent assistants in the physical world with multimodal sensing techniques and human-AI interaction
designs. I achieve this by ubiquitously digitizing user behavior (pose, gesture, gaze, activity, speech, etc.) and designing helpfulintervention with practical devices, such as smartwatch. I explore ways to use AI systems accountably when ML models are notreliable in critical domains like healthcare and well-being support. I am currently developing assistants for people withneurological disorders like ADHD and dementia.

Education
Carnegie Mellon University
School of Computer Science, Human-Computer Interaction Institute, Ph.D. Program
Adviser: Dr. Mayank Goel
The University of Tokyo
M.S. in Information Physics & Computing; GPA 4.0/4.0, Dean’s Award

Pittsburgh, PA, USA; 2021.9 - Current

Tokyo, Japan; 2019.4 - 2021.3

Adviser: Dr. Masahiko Inami
Master thesis: Mindless Computing through Auditory Intervention
The University of Tokyo
Tokyo, Japan; 2015.4 - 2019.3
B.E. in Mathematical Engineering & Information Physics; GPA 3.89/4.0
Adviser: Dr. Hiroshi Saruwatari and Dr. Shoichi Koyama
Graduation thesis: DNN-Based Voice Conversion and Its Quality Improvements by Audio Data Augmentation

Selected Honors and Awards
Research Fellowships and Grants
2024
Quad Fellowship2023
Center for Machine Learning and Health (CMU CMLH), Translational Fellowship
2022
Snap Research Fellowship2022-26 Masason Foundation Scholarship2021-22 Funai Overseas Scholarship2021
Research Fellowship for Young Scientists (DC1), Japan Society for the Promotion of Science
Academic Honors and Awards
2023
CHI 2023 Honorable Mention Award (top 5%)
2023
CHI 2023 Honorable Case Study Recognition (top 3)
2021
CHI 2021 Honorable Mention Award (top 5%)
2021
Dean’s Award from The University of Tokyo (the department’s representative student at the graduation ceremony)2021
1st CHIIoT Workshop Best Paper Award (top 1)
2020
CHI 2020 Best Paper Award (top 1%)
2015
Tokyo Governor’s Award for academic grades
Misc.
2024
2023
2019
2018
2017
2014

Forbes Asia 30 under 30 (healthcare and science)
Forbes Japan 30 under 30 (science and technology)
International Virtual Reality Contest, Laval Virtual prize & Unity prize
James Dyson Award; 1st prize in Japan
Stanford Health Hackathon; 3rd prize and best design award
Asian Science Camp; Math prize

Riku Arakawa

C.V. - 2

Peer-Reviewed Journal Papers[J.7] Riku Arakawa, Jill Fain Lefman, Mayank Goel. PrISM-Q&A: Step-Aware Question Answering with Large Language
Models Enabled by Multimodal Procedure Tracking using a Smartwatch. Proceedings of the ACM on Interactive Mobile Wearable
Ubiquitous Technology, Volume 8, Issue 4. To Appear in Ubicomp’25.
[J.6] Riku Arakawa, Bing Zhou, Gurunandan Krishnan, Mayank Goel, Shree K. Nayar. MI-Poser: Human Body Pose Tracking
using Magnetic and Inertial Sensor Fusion with Metal Interference Mitigation. Proceedings of the ACM on Interactive Mobile
Wearable Ubiquitous Technology, Volume 7, Issue 3. Appeared in Ubicomp’23.
[J.5] Riku Arakawa, Karan Ahuja, Kristie Mak, Gwendolyn Thompson, Sam Shaaban, Oliver Lindhiem, Mayank Goel.
LemurDx: Using Unconstrained Passive Sensing for an Objective Measurement of Hyperactivity in Children with no Parent Input.
Proceedings of the ACM on Interactive Mobile Wearable Ubiquitous Technology, Volume 7, Issue 2. Appeared in Ubicomp’23.
[J.4] Riku Arakawa, Hiromu Yakura, Vimal Mollyn, Suzanne Nie, Emma Russell, Dustin P. Demeo, Haarika A. Reddy,Alexander K. Maytin, Bryan T. Carroll, Jill Fain Lehman, Mayank Goel. PrISM-Tracker: A Framework for Multimodal Procedure
Tracking Using Wearable Sensors and State Transition Information with User-Driven Handling of Errors and Uncertainty.
Proceedings of the ACM on Interactive Mobile Wearable Ubiquitous Technology, Volume 6, Issue 4. Appeared in Ubicomp’23.
[J.3] Chengshuo Xia, Xinrui Fang, Riku Arakawa, Yuta Sugiura. VoLearn: A Cross-Modal Operable Motion-Learning System
Combined with Virtual Avatar and Auditory Feedback. Proceedings of the ACM on Interactive Mobile Wearable UbiquitousTechnology, Volume 6, Issue 2. Appeared in Ubicomp’22.
[J.2] Yohei Kiguchi, Melvyn Weeks, Riku Arakawa. Predicting Winners and Losers under Time-Of-Use Tariffs Using Smart
Meter Data. Energy, Volume 236.
[J.1] Riku Arakawa, Hiromu Yakura (equal contribution). Reaction or Speculation: Building Computational Support for Users in
Catching-Up Series Based on an Emerging Media Consumption Phenomenon. Proceedings of the ACM on Human-Computer
Interaction, Volume 5, Issue CSCW1. Appeared in CSCW’21.

Peer-Reviewed Conference Papers[C.20] Riku Arakawa, Hiromu Yakura, Mayank Goel. PrISM-Observer: Intervention Agent to Help Users Perform Everyday
Procedures Sensed using a Smartwatch. Proceedings of the 37th Annual ACM Symposium on User Interface and Software
Technology (UIST’24), Pittsburgh USA, Oct. 2024. (acceptance ratio: 24%)
[C.19] Riku Arakawa, Hiromu Yakura (equal contribution). Coaching Copilot: Blended Form of an LLM-Powered Chatbot anda Human Coach to Effectively Support Self-Reflection for Leadership Growth. Proceedings of the 6th ACM Conference onConversational User Interfaces (CUI’24), Luxembourg City Luxembourg, July. 2024. (acceptance ratio: 30%)
[C.18] Riku Arakawa, Mathieu Parvaix, Chiong Lai, Hakan Erdogan, Alex Olwal. Quantifying the Effect of Simulator-Based
Data Augmentation for Speech Recognition on Augmented Reality Glasses. Proceedings of 2024 IEEE International Conferenceon Acoustics, Speech and Signal Processing (ICASSP’24), Seoul South Korea, Apr. 2024. (acceptance ratio: 45%)
[C.17] Riku Arakawa (*), Hiromu Yakura (*), Masataka Goto (*: equal contribution). CatAlyst: Domain-Extensible Interventionfor Preventing Task Procrastination Using Large Generative Models. Proceedings of the 2023 CHI Conference on Human Factors
in Computing Systems (CHI’23), Hamburg Germany, Apr. 2023. (acceptance ratio: 28.4%)[C.16] Vimal Mollyn, Riku Arakawa, Mayank Goel, Chris Harrison, Karan Ahuja. IMUPoser: Full-Body Pose Estimation using
IMUs in Phones, Watches, and Earbuds. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI’23), Hamburg Germany, Apr. 2023.
Honorable Mention Award (acceptance ratio: 28.4%)

Riku Arakawa

C.V. - 3[C.15] Tianhong Catherine Yu, Riku Arakawa, James McCann, Mayank Goel. uKnit: A Position-Aware Reconfigurable
Machine-Knitted Wearable for Gestural Interaction and Passive Sensing using Electrical Impedance Tomography. Proceedings ofthe 2023 CHI Conference on Human Factors in Computing Systems (CHI’23), Hamburg Germany, Apr. 2023. (acceptance ratio:28.4%)[C.14] Riku Arakawa, Mayank Goel, Chris Harrison, Karan Ahuja. RGBDGaze: Gaze Tracking on Smartphones with RGB andDepth Data. Proceedings of the 2022 International Conference on Multimodal Interaction (ICMI’22), Bengaluru India, Nov. 2022.
(acceptance ratio: 33%)
[C.13] Kiyosu Maeda, Riku Arakawa, Jun Rekimoto. CalmResponses: Displaying Collective Audience Reactions in RemoteCommunication. Proceedings of the 2022 ACM International Conference on Interactive Media Experience (IMX’22), Hybrid
Event Portugal, June 2022. (acceptance ratio: 40%)
[C.12] Riku Arakawa (*), Hiromu Yakura (*), Sosuke Kobayashi (*: equal contribution). VocabEncounter: NMT-powered
Vocabulary Learning by Presenting Computer-Generated Usages of Foreign Words into Users’ Daily Lives. Proceedings of the2022 CHI Conference on Human Factors in Computing Systems (CHI’22), Hybrid Event USA, Apr. 2022. (acceptance ratio:24.7%)[C.11] Riku Arakawa (*), Hiromu Yakura (*), Masataka Goto (*: equal contribution). BeParrot: Efficient Interface forTranscribing Unclear Speech via Respeaking. Proceedings of the 27th International Conference on Intelligent User Interface(IUI’22), Virtual Event Finland, Mar. 2022. (acceptance ratio: 24.5%)[C.10] Iori Yanokura, Naoki Wake, Kazuhiro Sasabuchi, Riku Arakawa, Kei Okada, Jun Takamatsu, Masayuki Inaba, Katsushi
Ikeuchi. A Multimodal Learning-from-Observation Towards All-at-once Robot Teaching using Task Cohesion. Proceedings ofthe 2022 IEEE/SICE International Symposium on System Integration (SII'22), Virtual Event Norway, Jan. 2022.
[C.9] Riku Arakawa, Zendai Kashino, Shinnosuke Takamichi, Adrien Verhulst, Masahiko Inami. Digital Speech Makeup: Voice
Conversion Based Altered Auditory Feedback for Transforming Self-Representation. Proceedings of the 2021 International
Conference on Multimodal Interaction (ICMI’21), Montreal Canada, Oct. 2021. (acceptance ratio: 42%)[C.8] Riku Arakawa, Hiromu Yakura (equal contribution). Mindless Attractor: A False-Positive Resistant Intervention forDrawing Attention Using Auditory Perturbation. Proceedings of the 2021 CHI Conference on Human Factors in Computing
Systems (CHI’21), Virtual Event Japan, May. 2021.
Honorable Mention Award (acceptance ratio: 26.3%)[C.7] Hideki Shimobayashi, Tomoya Sasaki, Arata Horie, Riku Arakawa, Zendai Kashino, Masahiko Inami. Independent Controlof Supernumerary Appendages Exploiting Upper Limb Redundancy. Proceedings of the Augmented Humans International
Conference 2021 (AHs’21), Virtual Event Finland, Feb. 2021.
[C.6] Naoki Wake, Riku Arakawa, Iori Yanokura, Takuya Kiyokawa, Kazuhiro Sasabuchi, Jun Takamatsu, Katsush Ikeuchi.
Learning-from-Observation Framework: One-Shot Robot Teaching for Grasp- Manipulation Release Household Operations.
Proceedings of the 2021 IEEE/SICE International Symposium on System Integration (SII’21), Virtual Event Japan, Jan. 2021.
[C.5] Riku Arakawa, Azumi Maekawa, Zendai Kashino, Masahiko Inami. Hand with Sensing Sphere: Body-Centered Spatial
Interactions with a Hand-Worn Spherical Camera. Proceesings of the 2020 ACM Symposium on Spatial User Interaction (SUI’20),
Virtual Event Canada, Oct. 2020. (acceptance ratio: 50%)
[C.4] Riku Arakawa, Hiromu Yakura (equal contribution). Mimicker-in-the-Browser: A Novel Interaction Using Mimicry toAugment the Browsing Experience. Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI’20),
Virtual Event Netherlands, Oct. 2020. (acceptance ratio: 37.6%)[C.3] Riku Arakawa, Hiromu Yakura (equal contribution). INWARD: A Computer-Supported Tool for Video Reflection
Improves Efficiency and Effectiveness in Executive Coaching. Proceedings of the 2020 CHI Conference on Human Factors inComputing Systems (CHI’20), Virtual Event USA, Apr. 2020. (acceptance ratio: 24.3%)

Riku Arakawa

C.V. - 4[C.2] Fabrice Matulic, Riku Arakawa, Brian Vogel, Daniel Vogel. PenSight: Enhanced Interaction with a Pen-Top Camera.
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI’20), Virtual Event USA, Apr. 2020.
Best Paper Award (acceptance ratio: 24.3%)[C.1] Riku Arakawa, Hiromu Yakura (equal contribution). REsCUE: A framework for REal-time feedback on behavioral CUEs
using multimodal anomaly detection. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI’19), Glasgow Scotland, May 2019. (acceptance ratio: 23.8%)

Peer-Reviewed Workshop/Poster/Demo Papers[W.8] Riku Arakawa, Mayank Goel. Unified Framework for Task Assistants powered by Multimodal Human Activity
Recognition. Human Activity Sensing Corpus and Applications Workshop (Ubicomp’24 HASCA workshop), Melbourne Australia,Oct. 2024.
[W.7] Riku Arakawa, Hiromu Yakura (equal contribution). AI for human assessment: What do professional assessors need?
Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI’23 case study), Hamburg
Germany, Apr. 2023.
Honorable Case Study Recognition (acceptance ratio: 30%)
[W.6] Riku Arakawa, Hiromu Yakura (equal contribution). Human-AI communication for human-human communication: Applying
interpretable unsupervised anomaly detection to executive coaching. Communication in Human-AI Interaction Workshop (IJCAI’22CHAI workshop), Hybrid Event Austria, July 2022.
[W.5] Riku Arakawa, Hiromu Yakura (equal contribution). AI for human assessment: What do professional assessors need?
Workshop on Trust and Reliance in AI-Human Teams (CHI’22 TRAIT workshop), Hybrid Event USA, Apr. 2022.
[W.4] Riku Arakawa, Yang Zhang. Low-Cost Millimeter-Wave Interactive Sensing through Origami Reflectors. 1st Workshop on
Computer Human Interaction in IoT Applications (CHIIoT’21), Virtual Event The Netherlands, Feb. 2021.
Best Paper Award[W.3] Riku Arakawa, Shintaro Shiba (equal contribution). Exploration of Reinforcement Learning for Event Camera using Carlike Robots. Workshop on Unconventional Sensors in Robotics (ICRA’22 workshop), Virtual Event France, May 2020.
[Po.2] Riku Arakawa (*), Yudai Tanaka (*), Hiromu Kawarasaki, Kiyosu Maeda (*: equal contribution). BulkScreen: SaliencyBased Automatic Shape Representation of Digital Images with a Vertical Pin Array Screen. Adjunct Publication of the 14th
International Conference on Tangible, Embedded, and Embodied Interaction (TEI’20 poster), Sydney, Feb. 2020.
[Po.1] Riku Arakawa, Shinnosuke Takamichi, Hiroshi Saruwatari. TransVoice: Real-Time Voice Conversion forAugmenting
Near-Field Speech Communication. Adjunct Publication of the 32nd Annual ACM Symposium on User Interface Software andTechnology (UIST’19 poster), New Orleans, Oct. 2019. (acceptance ratio: 48.8%)[W.2] Riku Arakawa, Shinnosuke Takamichi, Hiroshi Saruwatari. Implementation of DNN-based real-time voiceconversion andits improvements by audio data augmentation and mask-shaped device. Proceedings of the 10th ISCA Speech Synthesis Workshop(SSW’10), Vienna, Sep. 2019.
[W.1] Riku Arakawa, Sosuke Kobayashi, Yuya Unno, Yuta Tsuboi, Shin-ichi Maeda. DQN-TAMER: Human-in-the-Loop
Reinforcement Learning with Intractable Feedback. Workshop on Human-Robot Teaming Beyond Human Operational Speeds andRobot Teammates Operating in Dynamic Unstructured Environments (ICRA’19 RT-DUNE workshop), Montreal, May 2019.

Patents[Pa.9] Egocentric human body pose tracking. US 2024-0103610.
[Pa.8] Speech information extraction device and its program. JP 2024-008068 (7507528).
[Pa.7] JP 2023-142598 (submitted).
[Pa.6] Vocabulary learning support system and program. JP 2022-068248.
[Pa.5] System and program. JP 2022-036531 (7288530).

Riku Arakawa

C.V. - 5[Pa.4] Speech information document device. JP 2022-142035 (7223469).
[Pa.3] Speech conversion device, speech conversion method, and speech conversion program. JP 2021-033129.
[Pa.2] Image sensor, image processing unit, image processing method, and program. JP 2020-198535 (7393851).
[Pa.1] Monitoring equipment, monitoring system, monitoring method, and monitoring program. JP 2020-091527 (6867701).

Academic Service
Organizing Committee
ACM CHI 2025 Paper Chair AssistantProgram Committee
ACM CHI LBW ’22, ’23, ’24External Reviewer (90+) / *: including special recognitions for outstanding reviews
ACM CHI ’21, ’22*, ’23, ’24
ACM UIST ’21, ’23, ’24*
ACM IMWUT ’23*, ’24
CHI LBW ’20, ’21 / CHI Interactivity ’21 / MobileHCI ’22, ’24* / CSCW ’20, ’21 / CSCW Poster ’23 / SUI ’23, ’24 /VRST ’23 / ISWC ’23 / ICMI LBR ’23 / IMX ’24 / DIS ’24 / CUI ’24 / ICRA ’21
Other
ACM UIST 2024 Student Volunteer

Teaching Experience
Teaching Assistant, Carnegie Mellon University
Machine Learning and Sensing for Healthcare (Dr. Mayank Goel and Dr. Justin Chan)
Programming User Interface (Dr. Scott Hudson)
Teaching Assistant, The University of Tokyo
First-Year Seminar for Natural Sciences Students: Virtual Reality (Dr. Atsushi Hiyama)2024.8 – 2024.12
2023.1 – 2023.5
2019.4 – 2019.7

Professional Experience
Research Intern @ Google
California, USA; 2023.5 – 2023.8Sound processing research advised by Dr. Mathieu Parvaix and Dr. Alex Olwal, resulting in one publication [C.18]
Research Intern @ Snap Research
New York, USA; 2022.5 – 2022.8
EMF sensing research advised by Dr. Bing Zhou and Dr. Shree K. Nayar, resulting in one publication [J.6]
Research Intern @ HiLab, UCLATokyo, Japan (remote); 2020.7 – 2021.1
MM-wave interactive sensing research advised by Dr. Yang Zhang, resulting in one publication [W.4]
Research Engineer @ Microsoft Development
Tokyo, Japan; 2019.10 – 2020.12
Learning-from-Demonstration research advised by Dr. Katsushi Ikeuchi, resulting in two publications [C.6, C.10]
Student Fellow Researcher @ Preferred Networks
Tokyo, Japan; 2019.7 – 2019.9
Pen+Tablet interaction research advised by Dr. Fabrice Matulic, resulting in one publication [C.2]
Project Engineer @ Preferred Networks
Tokyo, Japan; 2017.5 – 2018.10
Interactive reinforcement learning research advised by Dr. Sosuke Kobayashi, resulting in one publication [W.1]