GitHub repository: ChaosCodes/LLMSpeculativeSampling
Primary language: Python
Description: Fast inference from large lauguage models via speculative decoding