GitHub repository: romsto/Speculative-Decoding
Primary language: Python
Created: 2024-04-22T10:31:22Z
Description: Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan et al. 2023.