GitHub repository: karrymao/Speculative-Decoding
Primary language: Python
Description: Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan et al. 2023.