Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
Kosmos-VENN-8B-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Model card Files Files and versions Community
1
Kosmos-VENN-8B-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 7 commits
MaziyarPanahi's picture
MaziyarPanahi
ce0c42750b08aef0dc6b814d9e4b9794d47d4b6d544a332037754baa009be17e
134f70b verified 4 months ago
  • .gitattributes
    1.9 kB
    ce0c42750b08aef0dc6b814d9e4b9794d47d4b6d544a332037754baa009be17e 4 months ago
  • Kosmos-VENN-8B-GGUF_imatrix.dat
    4.99 MB
    LFS
    ce0c42750b08aef0dc6b814d9e4b9794d47d4b6d544a332037754baa009be17e 4 months ago
  • Kosmos-VENN-8B.Q5_K_M.gguf
    5.73 GB
    LFS
    a57df2dc91914bb0ae3788da06fa0685802ae5d0eac1b0987671bc6953815b1e 4 months ago
  • Kosmos-VENN-8B.Q5_K_S.gguf
    5.6 GB
    LFS
    c312332eaa491cf87247b2a8a8bccbf849a4a633d234ce1669bb716a443eaa38 4 months ago
  • Kosmos-VENN-8B.Q6_K.gguf
    6.6 GB
    LFS
    c6d06d484ab1006c58596dd08ac88397bd7564f15d29c7b5cbd8b0949e579198 4 months ago
  • Kosmos-VENN-8B.Q8_0.gguf
    8.54 GB
    LFS
    bf6fbf1b5871245c457178ac843fe4663598fc0e34e8f208e47423c80e381191 4 months ago
  • Kosmos-VENN-8B.fp16.gguf
    16.1 GB
    LFS
    4673af3f846d5a7c3ba7005078f5460b24f4e9914ca7e7fe661eb85aa42f5596 4 months ago
  • README.md
    2.94 kB
    ce0c42750b08aef0dc6b814d9e4b9794d47d4b6d544a332037754baa009be17e 4 months ago