Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mohitsha
/
Llama-2-70b-chat-hf-FP8-KV
like
0
Text Generation
Transformers
Safetensors
llama
conversational
Inference Endpoints
text-generation-inference
License:
llama2
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
Edit model card
README.md exists but content is empty. Use the
Edit model card
button to edit it.
Downloads last month
0
Safetensors
Model size
69B params
Tensor type
FP16
·
Inference API
Text Generation
Examples
Input a message to start chatting with
mohitsha/Llama-2-70b-chat-hf-FP8-KV
.
Send
Model is too large to load in Inference API (serverless). To try the model, launch it on
Inference Endpoints (dedicated)
instead.
JSON Output
Maximize
Collection including
mohitsha/Llama-2-70b-chat-hf-FP8-KV
FP8 KV Cache
Collection
Models with FP8 KV Cache Scales
•
6 items
•
Updated
5 days ago