Worked-math notes on KV cache, prefill/decode, batching, quantization, serving engines + KV-cache calculator. Free course: inference-engineering.xyz
Inference Engineering Academy
inference-engineering-academy
AI & ML interests
Free and Pro courses on LLM inference: vLLM, SGLang, KV cache, batching, quantization.
Recent Activity
updated a collection 1 day ago
LLM Inference Engineering: notes & tools updated a Space 9 days ago
inference-engineering-academy/llm-kv-cache-calculator published a Space 9 days ago
inference-engineering-academy/llm-kv-cache-calculatorOrganizations
None yet