GitHub repository: FasterDecoding/REST
Primary language: C
Description: REST: Retrieval-Based Speculative Decoding, NAACL 2024