Hugging Face's logo

neuralmagic-ent
/
Llama-3.1-8B-quantized.w8a8

Text Generation
Safetensors
llama
int8
vllm
quantized
8-bit precision
compressed-tensors
Model card Files Community
Llama-3.1-8B-quantized.w8a8 / recipe.yaml

Commit History

Upload folder using huggingface_hub
3319044
verified

nm-research commited on