GitHub repository: Infini-AI-Lab/TriForce
Primary language: Python
Description: TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding