Model: inference-optimization/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Head
Author: inference-optimization
Tags: safetensors, llama, base_model:meta-llama/Llama-3.1-8B-Instruct, base_model:quantized:meta-llama/Llama-3.1-8B-Instruct, license:apache-2.0, compressed-tensors, region:us
Base models (quantized): id: meta-llama/Llama-3.1-8B-Instruct
Card metadata: license: apache-2.0
base_model: meta-llama/Llama-3.1-8B-Instruct
Likes: 0 | All-time downloads: 62
Created: 2025-12-04 13:05:54