Yusuke Matsui

The University of Tokyo, 7-3-1 Hongo
Bunkyo-ku, Tokyo, 113-8656, Japan# matsui@hal.t.u-tokyo.ac.jp
 http://yusukematsui.me

Research Interests
Computer vision, data structure, and machine Learning.

Education
2013–2016 PhD, Information Science and Technology, The University of Tokyo, Japan
Advisor: Prof. Kiyoharu Aizawa
Thesis: Retrieval and Drawing Assistance for Manga

2011–2013 MA, Interdisciplinary Information Studies, The University of Tokyo, Japan
2007–2011 BE, Information and Communication Engineering, The University of Tokyo, Japan

Research and Work Experience
2020–Present Lecturer (Assistant Professor), Department of Information and Communication Engineering,Graduate School of Information Science and Technology,, The University of Tokyo, Japan
2019–2020 Assistant Professor, Institute of Industrial Science, The University of Tokyo, Japanat Prof. Yoichi Sato’s Lab

2016–2018 Postdoctoral Researcher, National Institute of Informatics, Japanat Prof. Shin’ichi Satoh’s Lab

Spring 2016 Visiting Student, Columbia University, New York, NY, USA
Mentor: Prof. Shih-Fu Chang

Summer 2014 Research Intern, Microsoft Research, Redmond, WA, USA
Mentor: Dr. Yinpeng Chen

Summer 2013 Research Intern, Microsoft Research Asia, Beijing, China
Mentor: Dr. Takaaki Shiratori

Journal Publications[1] Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa, “PQTable: Nonexhaustive Fast Search for
Product-Quantized Codes Using Hash Tables”, IEEE Transactions on Multimedia, (TMM), 2018.
[2] Yusuke Matsui, Yusuke Uchida, Hervé Jégou, Shin’ichi Satoh, “A Survey of Product Quantization”,
ITE Transactions on Media Technology and Applications, (ITE), 2018.
[3] Yusuke Matsui, Takaaki Shiratori, Kiyoharu Aizawa, “DrawFromDrawings: 2D Drawing Assistancevia Stroke Interpolation with a Sketch Database”, IEEE Transactions on Visualization andComputer Graphics, (TVCG), 2017.
[4] Yusuke Matsui, Kota Ito, Yuji Aramaki, Azuma Fujimoto, Toru Ogawa, Toshihiko Yamasaki,Kiyoharu Aizawa, “Sketch-based Manga Retrieval using Manga109 Dataset”, Multimedia Toolsand Applications, (MTAP), 2017.
[5] Hiroyuki Deguchi, Taro Watanabe, Yusuke Matsui, Masao Utiyama, Hideki Tanaka, Eiichiro
Sumita, “Subset Retrieval Nearest Neighbor Machine Translation”, Journal of Natural Language
Processing, accepted, 2024.
[6] Andreu Girbau, Tetsuro Kobayashi, Benjamin Renoust, Yusuke Matsui, Shin’ichi Satoh, “FaceDetection, Tracking, and Classification from Large-Scale News Archives for Analysis of Key
Political Figures”, Political Analysis, 2024.
1/6

[7] Kiyoharu Aizawa, Azuma Fujimoto, Atsushi Otsubo, Toru Ogawa, Yusuke Matsui, Koki Tsubota, Hikaru Ikuta, “Building a Manga Dataset ”Manga109” with Annotations for Multimedia
Applications”, IEEE MultiMedia, 2020.

Conference Publications[1] Yusuke Matsui, Yoshiki Imaizumi, Naoya Miyamoto, Naoki Yoshifuji, “ARM 4-bit PQ: SIMDbased Acceleration for Approximate Nearest Neighbor Search on ARM”, International Conferenceon Acoustics, Speech, and Signal Processing, (ICASSP), 2022.
[2] Yusuke Matsui, Ryota Hinami, Shin’ichi Satoh, “Reconfigurable Inverted Index”, ACM International Conference on Multimedia, (ACMMM), Oral, 2018.
[3] Yusuke Matsui, Shin’ichi Satoh, “Revisiting Column-Wise Vector Quantization for MemoryEfficient Matrix Multiplication”, IEEE International Conference on Image Processing, (ICIP),2018.
[4] Yusuke Matsui, Keisuke Ogaki, Toshihiko Yamasaki, Kiyoharu Aizawa, “PQk-means: Billionscale Clustering for Product-quantized Codes”, ACM International Conference on Multimedia,(ACMMM), 2017.
[5] Yusuke Matsui, “Challenge for Manga Processing: Sketch-based Manga Retrieval”, ACM International Conference on Multimedia, (ACMMM), Doctoral Symposium, 2015.
[6] Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa, “PQTable: Fast Exact AsymmetricDistance Neighbor Search for Product Quantization using Hash Tables”, IEEE International
Conference on Computer Vision, (ICCV), 2015.
[7] Yusuke Matsui, Kiyoharu Aizawa, Yushi Jing, “Sketch2Manga: Sketch-based Manga Retrieval”,
IEEE International Conference on Image Processing, (ICIP), 2014.
[8] Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa, “Interactive Manga Retargeting”, ACM
SIGGRAPH, Poster, 2011.
[9] Yingxuan Li, Kiyoharu Aizawa, Yusuke Matsui, “Manga109Dialog: A Large-scale Dialogue
Dataset for Comics Speaker Detection”, IEEE International Conference on Multimedia and Expo,(ICME), 2024.
[10] Jeonghun Baek, Yusuke Matsui, Kiyoharu Aizawa, “Cross-Lingual Learning in Multilingual
Scene Text Recognition”, International Conference on Acoustics, Speech and Signal Processing,(ICASSP), 2024.
[11] Naoki Ono, Yusuke Matsui, “Relative NN-Descent: A Fast Index Construction for Graph-BasedApproximate Nearest Neighbor Search”, ACM International Conference on Multimedia, (ACMMM),
2023.
[12] Hiroyuki Deguchi, Taro Watanabe, Yusuke Matsui, Masao Utiyama, Hideki Tanaka, Eiichiro
Sumita, “Subset Retrieval Nearest Neighbor Machine Translation”, Association for Computational
Linguistics, (ACL), 2023.
[13] Jeonghun Baek, Eunchung Noh, Yusuke Matsui, Kiyoharu Aizawa, “Character Image Combination
for Multilingual Scene Text Recognition: Can We Make High-Performance Synthetic Data Without
Fonts?”, International Conference on Computer Vision, Workshop Towards the Next Generationof Computer Vision Datasets, (ICCV WS (TNGCV)), 2023.
[14] Hiroki Azuma, Yusuke Matsui, “Defense-Prefix for Preventing Typographic Attacks on CLIP”,
International Conference on Computer Vision, Workshop on Adversarial Robustness In the RealWorld, (ICCV WS (AROW)), 2023.
[15] Yutaro Oguri, Yusuke Matsui, “General and Practical Tuning Method for Off-the-Shelf GraphBased Index”, International Conference on Similarity Search and Applications, (SISAP), Indexing
Challenge Report by Team Utokyo, 2023.

2/6

[16] Atsuki Sato, Yusuke Matsui, “Fast Partitioned Learned Bloom Filter”, Neural Information Processing Systems, (NeurIPS), 2023.
[17] Jeonghun Baek, Yusuke Matsui, Kiyoharu Aizawa, “COO: Comic Onomatopoeia Dataset for
Recognizing Arbitrary or Truncated Texts”, European Conference on Computer Vision, (ECCV),
2022.
[18] Keita Awane, Daichi Horita, Hikaru Ikuta, Yusuke Matsui, Kiyoharu Aizawa, Naohiro Yanase,“Translation of Illustration Artist Style using Sailormoonredraw Data”, IEEE International Conference on Image Processing, (ICIP), 2022.
[19] Hikaru Ikuta, Runtian Yu, Yusuke Matsui, Kiyoharu Aizawa, “Towards Content-Aware PixelWise Comic Panel Segmentation”, International Workshop on Comics Analysis, Processing andUnderstanding, (MANPU), 2022.
[20] Ryota Hinami, Shonosuke Ishiwatari, Kazuhiko Yasuda, Yusuke Matsui, “Towards Fully AutomatedManga Translation”, AAAI Conference on Artificial Intelligence, (AAAI), 2021.
[21] Naoki Ono, Kiyoharu Aizawa, Yusuke Matsui, “Comic Image Inpainting via Distance Transform”,
ACM SIGGRAPH Asia, Technical Communications, 2021.
[22] Yoichiro Hisadome, Yusuke Matsui, “Cascading Feature Extraction for Fast Point Cloud Registration”, British Machine Vision Conference, (BMVC), 2021.
[23] Jeonghun Baek, Yusuke Matsui, Kiyoharu Aizawa, “What If We Only Use Real Datasets forScene Text Recognition? Toward Scene Text Recognition With Fewer Labels”, Conference on
Computer Vision and Pattern Recognition, (CVPR), 2021.
[24] Keita Awane, Koki Tsubota, Hikaru Ikuta, Yusuke Matsui, Kiyoharu Aizawa, Naohiro Yanase,“Improving the Quality of Illustrations: Transforming Amateur Illustrations to a ProfessionalStandard”, IEEE International Conference on Image Processing, (ICIP), 2021.
[25] Kimihiro Tanaka, Yusuke Matsui, Shin’ichi Satoh, “Efficient Nearest Neighbor Search by Removing
Anti-hub”, International Conference on Multimedia Retrieval, (ICMR), 2021.
[26] Fan Yang, Ryota Hinami, Yusuke Matsui, Steven Ly, Shin’ichi Satoh, “Efficient Image Retrieval
via Decoupling Diffusion into Online and Offline Processing”, AAAI Conference on ArtificialIntelligence, (AAAI), 2019.
[27] Haolin Ren, Fan Yang, Benjamin Renoust, Yusuke Matsui, Tetsuro Kobayashi, Shin’ichi Satoh,“Evaluating Face Tracking for Political Analysis in Japanese News Over a Long Period of Time”,
IEEE/WIC/ACM International Conference on Web Intelligence, (WI), 2019.
[28] Ryota Hinami, Yusuke Matsui, Shin’ichi Satoh, “Region-based Image Retrieval Revisited”, ACM
International Conference on Multimedia, (ACMMM), Oral, 2017.
[29] Junfu Pu, Yusuke Matsui, Fan Yang, Shin’ichi Satoh, “Energy based Fast Event Retrieval inVideo with Temporal Match Kernel”, IEEE International Conference on Image Processing, (ICIP),
2017.
[30] Chairath Sirirattanapol, Yusuke Matsui, Shin’ichi Satoh, Kuninori Matsuda, Kazuaki Yamamoto,“Deep Image Retrieval Applied on Kotenseki Ancient Japanese Literature”, IEEE International
Workshop on Machine Learning and Computing for Visual Semantic Analysis, (MLCSA), 2017.
[31] Yuji Aramaki, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa, “Text Detection in Mangaby Combining Connected-omponent-based and Region-based Classifications”, IEEE International
Conference on Image Processing, (ICIP), 2016.
[32] Toru Ogawa, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa, “Sketch Simplification byClassifying Strokes”, International Conference on Pattern Recognition, (ICPR), 2016.
[33] Kota Ito, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa, “Interactive Region Segmentationfor Manga”, International Conference on Pattern Recognition, (ICPR), 2016.

3/6

[34] Azuma Fujimoto, Toru Ogawa, Kazuyoshi Yamamoto, Yusuke Matsui, Toshihiko Yamasaki,Kiyoharu Aizawa, “Manga109 Dataset and Creation of Metadata”, International Workshop onComics Analysis, Processing and Understanding, (MANPU), 2016.
[35] Masaki Saito, Yusuke Matsui, “Illustration2vec: A Semantic Vector Representation of Illustrations”, ACM SIGGRAPH Asia, Technical Brief, 2015.
[36] Yuji Aramaki, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa, “Interactive Segmentation
for Manga using Lossless Thinning and Coarse Labeling”, APSIPA ASC, 2015.
[37] Kota Ito, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa, “Separation of Manga Line
Drawings and Screentones”, Eurographics, Short Paper, 2015.
[38] Yuji Aramaki, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa, “Interactive Segmentationfor Manga”, ACM SIGGRAPH, Poster, 2014.
[39] Daiki Matsumoto, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa, Takanori Katagiri,“IllustStyleMap: Visualization of Illustrations based on Similarity of Drawing Style of Authors”,
ACM SIGGRAPH, Poster, 2014.
[40] Kazuhiro Sato, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa, “Reference based Manga
Colorization by Graph Correspondence Using Quadratic Programming”, ACM SIGGRAPH Asia,Technical Brief, 2014.
[41] Saemi Choi, Yusuke Matsui, Kiyoharu Aizawa, “Diffusion : Change an Ambience of the Spacewith a Small Amount of Ink”, ACM SIGGRAPH Asia, Poster, 2014.

Technical Reports[1] Yutaro Oguri, Yusuke Matsui, “Theoretical and Empirical Analysis of Adaptive Entry Point
Selection for Graph-based Approximate Nearest Neighbor Search”, arXiv, 2024.
[2] Hiroki Azuma, Yusuke Matsui, Atsuto Maki, “ZoDi: Zero-Shot Domain Adaptation with DiffusionBased Image Transfer”, arXiv, 2024.
[3] Hiroki Azuma, Yusuke Matsui, “Defense-Prefix for Preventing Typographic Attacks on CLIP”,arXiv, 2023.
[4] Atsuki Sato, Yusuke Matsui, “Fast Partitioned Learned Bloom Filter”, arXiv, 2023.
[5] Yutaro Oguri, Yusuke Matsui, “General and Practical Tuning Method for Off-the-Shelf GraphBased Index: SISAP Indexing Challenge Report by Team Utokyo”, arXiv, 2023.
[6] Yingxuan Li, Kiyoharu Aizawa, Yusuke Matsui, “Manga109Dialog A Large-scale Dialogue Dataset
for Comics Speaker Detection”, arXiv, 2023.
[7] Naoki Ono, Yusuke Matsui, “Relative NN-Descent: A Fast Index Construction for Graph-BasedApproximate Nearest Neighbor Search”, arXiv, 2023.
[8] Ryoya Nara, Yusuke Matsui, “Adversarial Doodles: Interpretable and Human-drawable Attacks
Provide Describable Insights”, arXiv, 2023.
[9] Yusuke Matsui, Yoshiki Imaizumi, Naoya Miyamoto, Naoki Yoshifuji, “ARM 4-bit PQ: SIMDbased Acceleration for Approximate Nearest Neighbor Search on ARM”, arXiv, 2022.
[10] Misaki Ohashi, Yusuke Matsui, “Unbiased Scene Graph Generation using Predicate Similarities”,arXiv, 2022.
[11] Yasunori Kudo, Keisuke Ogaki, Yusuke Matsui, Yuri Odagiri, “Unsupervised Adversarial Learningof 3D Human Pose from 2D Joint Locations”, arXiv, 2018.
[12] Toru Ogawa, Atsushi Otsubo, Rei Narita, Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa,“Object Detection for Comics using Manga109 Annotations”, arXiv, 2018.
[13] Yusuke Matsui, Toshihiko Yamasaki, Kiyoharu Aizawa, “PQTable: Non-exhaustive Fast Search
for Product-quantized Codes using Hash Tables”, arXiv, 2017.

4/6

[14] Yusuke Matsui, Keisuke Ogaki, Kiyoharu Aizawa, Toshihiko Yamasaki, “PQk-means: Billion-scale
Clustering for Product-quantized Codes”, arXiv, 2017.
[15] Yusuke Matsui, Kota Ito, Yuji Aramaki, Toshihiko Yamasaki, Kiyoharu Aizawa, “Sketch-based
Manga Retrieval using Manga109 Dataset”, arXiv, 2015.

Awards (by myself and my students)
2024
2023
2023
2023
2022
2022
2021
2021
2018

Best Teaching Award, Faculty of Engineering, The University of Tokyo, Yusuke Matsui
Outstanding Reviewer, CVPR, Yusuke Matsui
Best Paper Award, ICCV AROW WS, Hiroki Azuma, Yusuke Matsui
2nd Place, SISAP Index Challenge, Task A, Yutaro Oguri, Yusuke Matsui
Outstanding Reviewer, ICMR, Yusuke Matsui
Outstanding Reviewer, ACCV, Yusuke Matsui
Outstanding Reviewer, CVPR, Yusuke Matsui
Outstanding Reviewer, ICCV, Yusuke Matsui
Outstanding Reviewer Award, ACM ICMR, Yusuke Matsui2018 7th place, Google Landmark Retrieval Challenge, Aimin Su, Steven Ly, Fan Yang, Ryota Hinami,Qier Meng, Sang Phan, Yusuke Matsui, Zheng Wang, Shin’ichi Satoh2018 7th place, Google Landmark Recognition Challenge, Aimin Su, Steven Ly, Fan Yang, Ryota
Hinami, Qier Meng, Sang Phan, Yusuke Matsui, Zheng Wang, Shin’ichi Satoh2018 Funai Research Award, Funai Foundation for Information Technology, Yusuke Matsui2016 Dean’s Award, Graduate School of Information Science and Technology, The University ofTokyo, Yusuke Matsui2013 Dean’s Award, Graduate School of Interdisciplinary Information Studies, The University ofTokyo, Yusuke Matsui2011 ACM Student Research Competition 3rd Place, ACM SIGGRAPH, Yusuke Matsui2011 Dean’s Award, Faculty of Engineering, The University of Tokyo, Yusuke Matsui

Invited Talks
2023 The Theory behind Vector DB, The 1st Japan-Korea Workshop on Artificial Intelligence,Yusuke Matsui2018 Manga109 and Beyond: Recent Advancement in Comic Image Processing, Naver,Yusuke Matsui2018 Sketch-based Manga Retrieval, Handai IDS-JFLI joint Workshop on Media and Graphics,Yusuke Matsui2017 Sketch-Based Image Retrieval And Data-Driven Drawing Assistance, Vietnam-Japan
Scientific Exchange Meeting (VJSE), Yusuke Matsui

Tutorials
2023 Neural Search in Action, CVPR 2023 Tutorial, Yusuke Matsui, Martin Aumüller, Han Xiao
2020 Effective and Efficient: Toward Open-world Instance Re-identification, ACMMM 2020
Tutorial, Zheng Wang, Wu Liu, Yusuke Matsui, Shin’ichi Satoh2020 Image Retrieval in the Wild, CVPR 2020 Tutorial, Yusuke Matsui, Takuma Yamaguchi, Zheng
Wang

Professional Activities/Service
2025 Registration Chair, MMM
5/6

2023
2023
2022
2019

Editorial Board, IJMIR
Senior Program Committee, IJCAILocal Chair, ACM Multimedia Asia
Local Chair, IEEE International Conference on Computational Photography

2019 Organizer, Multi-Discipline Approach for Learning Concepts - Zero-Shot, One-Shot, Few- Shotand Beyond (ICCV Workshop)
2018 General Chair, International Workshop on coMics ANalysis, Processing and Understanding
2018 Publication Chair, ACM International Conference on Multimedia Retrieval
2017 Program Chair, International Workshop on coMics ANalysis, Processing and Understanding
Last updated: March 23, 2024

6/6