Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads
Paper
•
2401.10774
•
Published
•
50
Hongwu Peng
harveyp123
AI & ML interests
Large Language model
Organizations
None yet