Post
1775
I have some New Year presents for you, #MachineLearning and #AI community! We just opened our code for new state-of-the-art results that beat EAGLE-2 and Medusa #LLM inference.
We also shared the model check pt on @huggingface ! @MatthieuZ
Check the blog out: https://huggingface.co/blog/hba123/sotaspeculativedecoding
We also shared the model check pt on @huggingface ! @MatthieuZ
Check the blog out: https://huggingface.co/blog/hba123/sotaspeculativedecoding