Bodun Hu
ContactInformation

E-mail: bodunhu@utexas.edu
Website: https://www.bodunhu.com

ResearchInterests

Systems for ML, Operating System, heterogeneity, ML SW-HW Co-design, Distributed SystemEducation

The University of Texas at Austin

2317 Speedway
The University of Texas at Austin
Austin, TX 78712 USA

Ph.D. in Computer Science
Advisor: Aditya Akella
The University of Texas at Austin
M.S. in Computer Science, May 2021
Advisor: Christopher J. Rossbach
The University of Texas at Austin
B.S. in Computer Science, May 2020 (Research Distinction)
Publications

Bodun Hu, Jiamin Li, Le Xu, Myungjin Lee, Akshay Jajoo, Geon-Woo Kim, Hong Xu, Aditya
Akella. 2024. BlockLLM: Multi-tenant Finer-grained Serving for Large Language Models. Preprint.
Ajay Jaiswal, Bodun Hu, Lu Yin, Yeonju Ro, Shiwei Liu, Tianlong Chen, Aditya Aeklla. 2024.
FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skipping.
EMNLP 24.
Bodun Hu, Le Xu, Jeongyoon Moon, Neeraja J. Yadwadkar, Aditya Akella. 2024. MOSEL:
Inference Serving Using Dynamic Modality Selection. EMNLP 24.
Henrique Fingler, Isha Tarte, Hangchen Yu, Ariel Szekely, Bodun Hu, Aditya Akella, ChristopherJ. Rossbach. Towards a Machine Learning-Assisted Kernel with LAKE. Proceedings of the International Conference on Architectural Support for Programming Languages and Operating System(ASPLOS).
Bodun Hu and Christopher J. Rossbach. 2020. Altis: Modernizing GPGPU Benchmarks. Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software(ISPASS).

ResearchExperience

The University of Texas at Austin (UT Austin), Austin, TX, USA.
Research Assistant2021 - Current
Implemented eﬀicient mutlimodal model inference system using learning-based optimization technique.
Designed dynamic memory management techniques to optimize the performance of sparse Llama-2model.
Intel, San Jose, TX, USA.
Research Intern
2022
TCP-INT: Improved Network Telemetry in TCP Transport for better e2e visibility and improved
closed-loop control of TCP workloads.

1

The University of Texas at Austin (UT Austin), Austin, TX, USA.
Research Assistant2017 - 2021
LAKE: Built a generic API remoting system to expose accelerator APIs to OS kernel with close-tonative performances.
ALTIS: Designed a benchmark with improved diversity over existing GPU benchmarks by extending
application domains with modern CUDA features.
The University of Texas at Austin (UT Austin), Austin, TX, USA.
Rearch Assistant
TAS: Ported TAS into P4 to facilitate TCP fast-path migration to programmable NICs.

2020

The University of Texas at Austin (UT Austin), Austin, TX, USA.
Rearch Assistant2016 - 2017
G-Code-gen: Designed an automated detection system utilizing readily available hardware, which
detects and terminates 3D printing processes upon identification of object defects.
IndustryExperience

H3C, Chengdu, China.
Software Engineering Intern
2018
Devised and implemented a highly effective caching strategy, resulting in a significant reduction ofvideo streaming processing latency on Kubernetes cluster by a factor of 3x.
Wisesoft, Chengdu, China.
Software Engineering Intern
2017
Developed a data preprocessing pipeline for improved audio classification in an air traﬀic control
system.

Honors andAwards

ISPASS Student Travel Award, 2020

Teaching

CS378: Multicore Operating System Implementation (undergraduate)
Teaching Assistant, UC Austin, Spring 2020

Talks

• Altis: Modernizing GPGPU Benchmarking, ISPASS’20 (August 2020)• Accelerating Kernel Access to Hardware Acceleration, Texas Systems Symposium (November2020)

Service• Junior Graduate Admissions Committee, UT Austin (Janurary 2021)

Research Distinction by the College of Natural Sciences (UT Austin), 2020.

2