Hugging Face's logo

nm-testing
/
Llama-2-70b-chat-hf-W8A8-Dynamic-Per-Token

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
8-bit precision
compressed-tensors
Model card Files Community
Llama-2-70b-chat-hf-W8A8-Dynamic-Per-Token
  • 1 contributor
 History: 3 commits
mgoin's picture
mgoin
Updated compression_config to quantization_config
a4c022f verified