Optimizing Large Language Model Training Using FP4 Quantization
Paper
•
2501.17116
•
Published
•
36
Guoshuai Zhao
crayonshine
AI & ML interests
None yet
Recent Activity
authored
a paper
about 1 month ago
Optimizing Large Language Model Training Using FP4 Quantization
authored
a paper
about 2 months ago
Sigma: Differential Rescaling of Query, Key and Value for Efficient
Language Models
upvoted
a
paper
10 months ago
FP8-LM: Training FP8 Large Language Models
Organizations
None yet
crayonshine's activity
authored
a
paper
about 1 month ago
authored
a
paper
about 2 months ago
upvoted
a
paper
10 months ago