matlok 's Collections
LMM

Papers - Speculative Decoding - Draft - Base Model - JF68M

we utilize a 4K retrieval cache as an intermediate draft cache in our hierarchical system, while leveraging the JackFram/Llama68M (JF68M) [28] model