Model: inference-optimization/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Tensor
Author: inference-optimization
Tags: safetensors, llama, license:apache-2.0, compressed-tensors, region:us
Card metadata: license: apache-2.0
Likes: 0 | All-time downloads: 28
Created: 2025-12-04 13:04:06