FP8 KV Cache - a mohitsha Collection

Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

mohitsha 's Collections

AMD RyzenAI Models

FP8 KV Cache

updated Jul 4

Models with FP8 KV Cache Scales

mohitsha/Llama-2-70b-chat-hf-FP8-KV

Text Generation • Updated Jun 25 • 19
mohitsha/Llama-2-7b-chat-hf-FP8-KV

Text Generation • Updated Jun 25 • 26
mohitsha/Llama-2-7b-chat-hf-FP8-KV-AMMO

Text Generation • Updated Jun 25 • 23
mohitsha/Llama-2-70b-chat-hf-FP8-KV-AMMO

Text Generation • Updated Jun 25 • 21
mohitsha/Llama-2-7b-chat-hf-FP8-FNUZ-KV-AMMO

Text Generation • Updated Jun 25 • 20

Collection guide
Browse collections

Company

TOS Privacy About Jobs

Website

Models Datasets Spaces Pricing Docs