Hugging Face model: nm-testing/Llama-3.3-70B-Instruct-QKV-Cache-FP8-Per-Tensor
Author: nm-testing
Created: 2025-11-25 18:49:39
Last modified: 2025-11-25 18:52:02
Library: transformers
Likes: 0 | Downloads: 0
Tags: transformers, kv-cache, fp8, endpoints_compatible, region:us
Card metadata:
library_name: transformers
tags: kv-cache, fp8