Model: nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Head
Author: nm-testing
Library: transformers
Tags: transformers, kv-cache, fp8, endpoints_compatible, region:us
Card metadata: library_name: transformers
tags: kv-cache, fp8
Likes: 0 | All-time downloads: 0
Created: 2025-11-25 18:49:33