Eloquent: A More Robust Transmission Scheme for LLM Token Streaming
Authors: Hanchen Li; Yuhan Liu; Yihua Cheng; Siddhant Ray; Kuntai Du; Junchen Jiang
Venue: SIGCOMM 2024
Datasets used: Cellular LLM Token-Streaming Packet Traces