Space: ai-engineering-at/llama-cpp-turboquant-guide
title: TurboQuant on Consumer GPUs — 100K Context on RTX 3090, 64K on RTX 4070
sdk: static
license: cc-by-4.0
tags: llm, quantization, kv-cache, turboquant, benchmark, rtx3090, rtx4070, consumer-hardware, mistral, llama-cpp
Tags: static, llm, quantization, kv-cache, turboquant, benchmark, rtx3090, rtx4070, consumer-hardware, mistral, llama-cpp, region:us