Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

RichardErkhov
/
nvidia_-_Llama-3.1-Nemotron-70B-Instruct-HF-gguf

GGUF
conversational
Model card Files Files and versions
xet
Community
nvidia_-_Llama-3.1-Nemotron-70B-Instruct-HF-gguf
Ctrl+K
Ctrl+K
  • 1 contributor
History: 20 commits
RichardErkhov's picture
RichardErkhov
uploaded model
a2569da verified 9 months ago
  • IQ4_NL
    uploaded model 9 months ago
  • Q4_1
    uploaded model 9 months ago
  • Q4_K
    uploaded model 9 months ago
  • Q4_K_M
    uploaded model 9 months ago
  • Q4_K_S
    uploaded model 9 months ago
  • Q5_0
    uploaded model 9 months ago
  • Q5_K
    uploaded model 9 months ago
  • Q5_K_M
    uploaded model 9 months ago
  • Q5_K_S
    uploaded model 9 months ago
  • .gitattributes
    4.2 kB
    uploaded model 9 months ago
  • Llama-3.1-Nemotron-70B-Instruct-HF.IQ3_M.gguf
    31.9 GB
    xet
    uploaded model 9 months ago
  • Llama-3.1-Nemotron-70B-Instruct-HF.IQ3_S.gguf
    30.9 GB
    xet
    uploaded model 9 months ago
  • Llama-3.1-Nemotron-70B-Instruct-HF.IQ3_XS.gguf
    29.3 GB
    xet
    uploaded model 9 months ago
  • Llama-3.1-Nemotron-70B-Instruct-HF.IQ4_XS.gguf
    38.3 GB
    xet
    uploaded model 9 months ago
  • Llama-3.1-Nemotron-70B-Instruct-HF.Q2_K.gguf
    26.4 GB
    xet
    uploaded model 9 months ago
  • Llama-3.1-Nemotron-70B-Instruct-HF.Q3_K.gguf
    34.3 GB
    xet
    uploaded model 9 months ago
  • Llama-3.1-Nemotron-70B-Instruct-HF.Q3_K_L.gguf
    37.1 GB
    xet
    uploaded model 9 months ago
  • Llama-3.1-Nemotron-70B-Instruct-HF.Q3_K_M.gguf
    34.3 GB
    xet
    uploaded model 9 months ago
  • Llama-3.1-Nemotron-70B-Instruct-HF.Q3_K_S.gguf
    30.9 GB
    xet
    uploaded model 9 months ago
  • Llama-3.1-Nemotron-70B-Instruct-HF.Q4_0.gguf
    40 GB
    xet
    uploaded model 9 months ago