Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
T3qm7xpT3q-7B-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
text-generation-inference
Model card Files Files and versions Community
1
T3qm7xpT3q-7B-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 9 commits
MaziyarPanahi's picture
MaziyarPanahi
d481499c88c0a93a0e58aca7dfd88ff0a1b8c1241769d12ade92f5ae874cc52e
acfc865 verified about 1 year ago
  • .gitattributes
    2.01 kB
    d481499c88c0a93a0e58aca7dfd88ff0a1b8c1241769d12ade92f5ae874cc52e about 1 year ago
  • T3qm7xpT3q-7B.IQ3_XS.gguf
    3.02 GB
    LFS
    54bf0d20477160510d9c9aca8cbe1d07e6934bb8eec22dfb8b343fd00dd97baa about 1 year ago
  • T3qm7xpT3q-7B.IQ4_XS.gguf
    3.94 GB
    LFS
    7051b2ec55358dfe82c9932991c52d1ca44e4077a60da9a4b7182a77a685c121 about 1 year ago
  • T3qm7xpT3q-7B.Q2_K.gguf
    2.72 GB
    LFS
    0d179e360ebf0d02fbe1ec1c8aaca4de5ef247a76841c821c254f058fe4cc85b about 1 year ago
  • T3qm7xpT3q-7B.Q3_K_L.gguf
    3.82 GB
    LFS
    dd34ddc50148922421a68e8138b6b5f022989be3bebf7795d7d238907217becc about 1 year ago
  • T3qm7xpT3q-7B.Q3_K_M.gguf
    3.52 GB
    LFS
    3d37ec7fab0539c88abf02d22e4377204df6ad6d77d8806e90de20e12e58933c about 1 year ago
  • T3qm7xpT3q-7B.Q3_K_S.gguf
    3.16 GB
    LFS
    ba7cd76e6be9381bf34d64d6093564dc371bf8d4ca446e6f2cfbdeb44dfedaca about 1 year ago
  • T3qm7xpT3q-7B.Q4_K_M.gguf
    4.37 GB
    LFS
    a382034355f08064a96b7b99af178af4e1fef85143e6e113d788aa369c6643d1 about 1 year ago
  • T3qm7xpT3q-7B.Q4_K_S.gguf
    4.14 GB
    LFS
    d481499c88c0a93a0e58aca7dfd88ff0a1b8c1241769d12ade92f5ae874cc52e about 1 year ago