Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
joshmiller656
/
Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4
like
2
Text Generation
Transformers
Safetensors
nvidia/HelpSteer2
8 languages
llama
nemotron
awq
quantized
int4
conversational
text-generation-inference
Inference Endpoints
4-bit precision
arxiv:
2410.01257
arxiv:
2405.01481
arxiv:
2406.08673
License:
llama3.1
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4
/
model-00008-of-00009.safetensors
Commit History
Upload folder using huggingface_hub
372de0b
verified
joshmiller656
commited on
23 days ago