Hugging Face model: harshithsaiv/kv-cache-compression
Author: harshithsaiv
Created: 2026-05-03 03:47:35
Last modified: 2026-05-03 04:25:24
Likes: 0 | Downloads: 0
Tags: quantization, kv-cache, llm-inference, cuda, triton, memory-efficient, mitral, llama, inference-optimization, 4-bit, mixed-precision, en, dataset:Salesforce/wikitext, base_model:meta-llama/Meta-Llama-3-8B-Instruct, base_model:finetune:meta-llama/Meta-Llama-3-8B-Instruct, license:mit, region:us
Base model relation: finetune
Base models: id: meta-llama/Meta-Llama-3-8B-Instruct
Card metadata:
license: mit
datasets: Salesforce/wikitext
language: en
metrics: perplexity
base_model: mistralai/Mistral-7B-Instruct-v0.3, meta-llama/Meta-Llama-3-8B-Instruct
tags: quantization, kv-cache, llm-inference, cuda, triton, memory-efficient, mitral, llama, inference-optimization, 4-bit, mixed-precision