GitHub repository: maxxcte/LLM-Sampling
Primary language: Python
Description: Accelerating large language model inference through speculative decoding