Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

bartowski
/
Hermes-2-Pro-Mistral-7B-GGUF

Text Generation
GGUF
English
Mistral
instruct
finetune
chatml
DPO
RLHF
gpt4
synthetic data
distillation
function calling
json mode
conversational
Model card Files Files and versions
xet
Community
Hermes-2-Pro-Mistral-7B-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 2 commits
bartowski's picture
bartowski
Llamacpp quants
9150f12 verified about 1 year ago
  • .gitattributes
    2.37 kB
    Llamacpp quants about 1 year ago
  • Hermes-2-Pro-Mistral-7B-Q2_K.gguf
    2.72 GB
    xet
    Llamacpp quants about 1 year ago
  • Hermes-2-Pro-Mistral-7B-Q3_K_L.gguf
    3.82 GB
    xet
    Llamacpp quants about 1 year ago
  • Hermes-2-Pro-Mistral-7B-Q3_K_M.gguf
    3.52 GB
    xet
    Llamacpp quants about 1 year ago
  • Hermes-2-Pro-Mistral-7B-Q3_K_S.gguf
    3.16 GB
    xet
    Llamacpp quants about 1 year ago
  • Hermes-2-Pro-Mistral-7B-Q4_0.gguf
    4.11 GB
    xet
    Llamacpp quants about 1 year ago
  • Hermes-2-Pro-Mistral-7B-Q4_K_M.gguf
    4.37 GB
    xet
    Llamacpp quants about 1 year ago
  • Hermes-2-Pro-Mistral-7B-Q4_K_S.gguf
    4.14 GB
    xet
    Llamacpp quants about 1 year ago
  • Hermes-2-Pro-Mistral-7B-Q5_0.gguf
    5 GB
    xet
    Llamacpp quants about 1 year ago
  • Hermes-2-Pro-Mistral-7B-Q5_K_M.gguf
    5.13 GB
    xet
    Llamacpp quants about 1 year ago
  • Hermes-2-Pro-Mistral-7B-Q5_K_S.gguf
    5 GB
    xet
    Llamacpp quants about 1 year ago
  • Hermes-2-Pro-Mistral-7B-Q6_K.gguf
    5.94 GB
    xet
    Llamacpp quants about 1 year ago
  • Hermes-2-Pro-Mistral-7B-Q8_0.gguf
    7.7 GB
    xet
    Llamacpp quants about 1 year ago
  • README.md
    3.74 kB
    Llamacpp quants about 1 year ago