Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
neuralmagic
/
Meta-Llama-3-70B-Instruct-FP8-KV
like
2
Follow
Neural Magic
184
Text Generation
Transformers
Safetensors
llama
fp8
vllm
conversational
text-generation-inference
Inference Endpoints
arxiv:
6 papers
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Meta-Llama-3-70B-Instruct-FP8-KV
/
model-00008-of-00015.safetensors
Commit History
Upload folder using huggingface_hub
eef3cb9
verified
mgoin
commited on
Jun 26