Kuan-Wei Tseng
Nishigotanda, Shinagawa-ku, Tokyo, Japan, 141-0031

Ó +81-80-5470-0716

Q kuanwei@g.ntu.edu.tw  https://kuan-wei-tseng.github.io

D OMAIN
E XPERTISE

Computer Vision (3D Computer Vision, View Synthesis, Object Tracking), Image and Video Processing (Style Transfer, Video Stabilization), SLAM (Sensor Fusion, Visual Odometry, LiDAR Odometry), Augmented/Virtual Reality (Education, Entertainment, Multisensory Experience)

E DUCATION

M.S., Department of Computer Science, Tokyo Institute of Technology
2022 – 2024/03• Advisors: Prof. Ikuro Sato and Prof. Rei Kawakami.
• Lab: Recognition and Learning Algorithm Laboratory (a.k.a. Sato Lab)
• Courses: Advanced Topics in Computer Vision, Advanced Topics in Artificial Intelligence, Sparse
Signal Processing & Optimization, Robot Audition and Scene Analysis
B.S., Department of Mechanical Engineering, National Taiwan University
2016 – 2020
• Advisor: Prof. Yi-Ping Hung (Department of Computer Science and Information Engineering)• Lab: Image and Vision Lab (imLab)• Courses: Digital Image Processing, Computer Vision, Advanced Computer Vision, Robotics,
Video Communications, Wireless Networking–Fundamentals and Applications, Numerical Methods, Data Visualization with Modern Data Science

W ORK &R ESEARCH
E XPERIENCE

Robotics and Automation Intern, Apple, Japan
2023/03 – Present• Implemented a robust context-aware 3D LiDAR Odometry based on Point Cloud Library (PCL)and ROS for robot navigation in large-scale (>100m) outdoor environments.
• Developed a simulation testing framework consists of environment setup, automatic testing, andresult analysis for efficient CI/CD. Reduced setup time from 30 minutes to just 1 minute.
Research Intern, Denso IT Laboratory, Japan
2022/11 – 2023/02• Developed transformer-based interactive object segmentation model that takes only 4 extreme
points as input for fast data annotation.
Graduate Research Assistant, National Taiwan University
2022/02–2022/09
Research Associate (Full-Time), National Taiwan University
2021/02–2022/01
Research Assistant (Full-Time), National Taiwan University
2020/08–2021/01
Undergraduate Research Assistant , National Taiwan University
2019/09–2020/07• Object Tracking. Led a team to work on visual object tracking. Devised a transformer-based one
stream object tracking model with adaptive template update strategies that achieves can at 65fps
with AUC 71.7 on LaSOT, a long-term object tracking benchmark.
• Sensor Fusion. Contributed to indoor UAV localization projects using deep selective fusion ofvision, IMU, and UWB sensors. Refined loss functions to increase global localization accuracy.
Recruited and trained a team to collect data with visual-inertial sensor and motion capture system.
• Image Processing. Designed and implemented ArtNV, a stylized novel view synthesis pipelinethat generate spatially consistent novel views for 3D displays. Integrated ArtNV into VR as analternative to modeling or 360 images for the unreachable areas in the virtual environment.
• 3D Perception. Contributed to GCVD, a globally consistent video depth and pose estimator that
improves state-of-the-art methods by 19% , and Deep3D, an learning-based video stabilizer thatfirst leveraged self-supervised learning of depth and pose to smooth camera motion.
• Virtual Reality. Developed an olfactory display system that exhausts scented gases by subwoofers to enhance immersive VR experience. Analyzed user experience on multisensory feedback and integrated multisensory experience into VR for relaxation.
• Augmented Reality. Explored practical applications of optical see-through head-mounted display
and designed a mixed reality navigation (image-based localization) and guidance (3D animationmanual) system for outdoor facility maintenance with Microsoft HoloLens 2.

T EACHINGE XPERIENCE

Teaching Assistant, Tokyo Institute of Technology
Fall 2022• LAS.I121/LAS.I122 Computer Science I/II (Python programming for undergraduate students.)
Teaching Assistant, National Taiwan University• CSIE 5079 Pattern Classification and Analysis• CSIE 5429 3D Computer Vision with Deep Learning Applications

S ELECTEDP UBLICATIONS

Spring 2021
Spring 2021, 2022

[1] Peng-Yuan Kao, Hsiu-Jui Chang, Kuan-Wei Tseng, Timothy Chen, He-Lin Luo, Yi-Ping Hung,"VIUNet: Deep Visual–Inertial–UWB Fusion for Indoor UAV Localization", in IEEE Access,2023. ®
[2] Kuan-Wei Tseng∗ , Jing-Yuan Huang∗ , Yang-Shen Chen, Chu-Song Chen, Yi-Ping Hung,"Pseudo-3D Scene Modeling for Virtual Reality Using Stylized Novel View Synthesis", in ACM
SIGGRAPH Posters, 2022. (∗ Co-first authors) ®
[3] Jing-Yuan Huang, Grace Theodore, You-Shin Tsai, Jerry Chin-Han Goh, Mu-Hang Lin, KuanWei Tseng, Yi-Ping Hung, "Exploring Multisensory Feedback for Virtual Reality Relaxation",in Proceedings of the IEEE International Conference on Multimedia and Expo Workshops(ICMEW), 2022. (Best Demo Paper) ®
[4] Kuan-Wei Tseng, Yao-Chih Lee, Chu-Song Chen, "Artistic Style Novel View Synthesis Basedon A Single Image", in Proceedings of the IEEE/CVF Conference on Computer Vision andPattern Recognition (CVPR) Workshops, 2022. ®
[5] You-Yang Hu, Yao-Fu Jan, Kuan-Wei Tseng, You-Shin Tsai, Hung-Ming Sung, Jin-Yao Lin,Yi-Ping Hung, "aBio: Active Bi-Olfactory Display Using Subwoofers for Virtual Reality", inProceedings of the 29th ACM International Conference on Multimedia (MM), 2021. (Oral Paper; Best Student Paper) ®
[6] Yao-Chih Lee, Kuan-Wei Tseng, Yu-Ta Chen, Chien-Cheng Chen, Chu-Song Chen, Yi-PingHung, "3D Video Stabilization with Depth Estimation by CNN-based Optimization", in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR),
2021. ®
[7] Yu-Ta Chen, Kuan-Wei Tseng, Yao-Chih Lee, Chun-Yu Chen, Yi-Ping Hung, "PixStabNet:
Fast Multi-Scale Deep Online Video Stabilization with Pixel-Based Warping", in Proceedingsof the IEEE International Conference on Image Processing (ICIP), 2021. ®
[8] Yao-Fu Juan, Kuan-Wei Tseng, Peng-Yuan Kao and Yi-Ping Hung, "Augmented Tai-Chi Chuan
Practice Tool with Pose Evaluation", in Proceedings of the IEEE International Conference on
Multimedia Information Processing and Retrieval (MIPR), 2021. (Oral Paper) ®
[9] Peng-Yuan Kao, Kuan-Wei Tseng, Tian-Yi Shen, Yan-Bin Song, Kuan-Wen Chen, Shih-Wei
Hu, Sheng-Wen Shih, and Yi-Ping Hung, "Camera Ego-Positioning Using Sensor Fusion andComplementary Method", in Pattern Recognition. ICPR International Workshops and Challenges, 2021. ®
[10] Kuan-Wei Tseng, Meng-Wei Hsu, Peng-Yuan Kao and Yi-Ping Hung, "Influence of IMU Quality on Optimization-Based Visual Inertial Odometry", in IPPR Conference on Computer Vision,Graphics, and Image Processing (CVGIP), 2020. (Presentation) ®

S ERVICES &H ONORS

Reviewer of CVPR Workshop 2023, WACV 2023, IEEE Signal Process. Lett. 2022
Best Demo Paper Award, IEEE International Conference on Multimedia & Expo (ICME)

2022

Best Student Paper Award, ACM International Conference on Multimedia (MM)2021

Best Paper Award, IPPR Conference on Computer Vision, Graphics, and Image Processing

2020

Kobe University Funds, Summer Program in Japanese Language and Culture

2019JASSO Scholarship, Nagoya University Short-Term Japanese Language Program

2018

C OMPETENCES Languages. Mandarin Chinese (native), English (fluent, TOEFL 104), Japanese (fluent, JLPT N1)
Programming Languages. Python, C++, MATLAB, C#Library, Software, and Tools. PyTorch, OpenCV, ROS, Gazebo, Unity, Git, LaTex