Space: TMLSNYC/speculative-cascades
title: Speculative Cascades: Latency-Optimal Inference via Coupled 
sdk: static
license: cc-by-4.0
tags: speculative-decoding, llm-serving, inference, latency
Tags: static, speculative-decoding, llm-serving, inference, latency, region:us