Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

bartowski
/
dolphin-2.9.2-qwen2-72b-GGUF

Text Generation
GGUF
Generated from Trainer
axolotl
imatrix
conversational
Model card Files Files and versions
xet
Community
dolphin-2.9.2-qwen2-72b-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 2 commits
bartowski's picture
bartowski
Llamacpp quants
21e2e11 verified 11 months ago
  • dolphin-2.9.2-qwen2-72b-Q5_K_M.gguf
    Llamacpp quants 11 months ago
  • dolphin-2.9.2-qwen2-72b-Q8_0.gguf
    Llamacpp quants 11 months ago
  • dolphin-2.9.2-qwen2-72b-f16.gguf
    Llamacpp quants 11 months ago
  • .gitattributes
    3.26 kB
    Llamacpp quants 11 months ago
  • README.md
    6.54 kB
    Llamacpp quants 11 months ago
  • dolphin-2.9.2-qwen2-72b-IQ1_M.gguf
    23.7 GB
    xet
    Llamacpp quants 11 months ago
  • dolphin-2.9.2-qwen2-72b-IQ2_M.gguf
    29.3 GB
    xet
    Llamacpp quants 11 months ago
  • dolphin-2.9.2-qwen2-72b-IQ2_XXS.gguf
    25.5 GB
    xet
    Llamacpp quants 11 months ago
  • dolphin-2.9.2-qwen2-72b-IQ3_M.gguf
    35.5 GB
    xet
    Llamacpp quants 11 months ago
  • dolphin-2.9.2-qwen2-72b-IQ3_XXS.gguf
    31.8 GB
    xet
    Llamacpp quants 11 months ago
  • dolphin-2.9.2-qwen2-72b-IQ4_XS.gguf
    39.7 GB
    xet
    Llamacpp quants 11 months ago
  • dolphin-2.9.2-qwen2-72b-Q2_K.gguf
    29.8 GB
    xet
    Llamacpp quants 11 months ago
  • dolphin-2.9.2-qwen2-72b-Q3_K_M.gguf
    37.7 GB
    xet
    Llamacpp quants 11 months ago
  • dolphin-2.9.2-qwen2-72b-Q3_K_S.gguf
    34.5 GB
    xet
    Llamacpp quants 11 months ago
  • dolphin-2.9.2-qwen2-72b-Q4_K_M.gguf
    47.4 GB
    xet
    Llamacpp quants 11 months ago
  • dolphin-2.9.2-qwen2-72b.imatrix
    25.2 MB
    xet
    Llamacpp quants 11 months ago