GitHub repository: FasterDecoding/Medusa
Primary language: Jupyter Notebook
Description: Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads