Zhaorui Yang's picture

4 1

Zhaorui Yang

zhaoruiyang

·

https://rickyang1114.github.io

rickyang1114

AI & ML interests

Trustworthy AI; Large Language Models

Recent Activity

authored a paper 17 days ago

Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning

upvoted an article about 2 months ago

Controlling Language Model Generation with NVIDIA's LogitsProcessorZoo

upvoted a paper 7 months ago

LLM Pruning and Distillation in Practice: The Minitron Approach

View all activity

Organizations

zhaoruiyang's activity

upvoted an article about 2 months ago

Article

Controlling Language Model Generation with NVIDIA's LogitsProcessorZoo

Dec 23, 2024

• 39

upvoted 2 papers 7 months ago

LLM Pruning and Distillation in Practice: The Minitron Approach

Paper • 2408.11796 • Published Aug 21, 2024 • 58

To Code, or Not To Code? Exploring Impact of Code in Pre-training

Paper • 2408.10914 • Published Aug 20, 2024 • 42

upvoted a paper 8 months ago

RegMix: Data Mixture as Regression for Language Model Pre-training

Paper • 2407.01492 • Published Jul 1, 2024 • 37