Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
Experiment28M7-7B-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
text-generation-inference
Model card Files Files and versions Community
1
Experiment28M7-7B-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 6 commits
MaziyarPanahi's picture
MaziyarPanahi
cb60c9a810d7cd3078516e960c93c828eed87de3047827c008ad1cd8cc118629
e1c3d81 verified about 1 year ago
  • .gitattributes
    1.85 kB
    cb60c9a810d7cd3078516e960c93c828eed87de3047827c008ad1cd8cc118629 about 1 year ago
  • Experiment28M7-7B.IQ3_XS.gguf
    3.02 GB
    LFS
    4cc2c0b77030dfc2109cacbe8aa35cf20fbb2a938d43c5ede6a519d4ab0dca13 about 1 year ago
  • Experiment28M7-7B.IQ4_XS.gguf
    3.94 GB
    LFS
    a18deb1b00abe75a9c9643939f0b38e4628441e7b0a0a08b018ee8530329cfc5 about 1 year ago
  • Experiment28M7-7B.Q2_K.gguf
    2.72 GB
    LFS
    f6cc0e96ddadec43f7b129e965d7003a9eaa7d8b463f58aa0a74639633dc4f51 about 1 year ago
  • Experiment28M7-7B.Q3_K_L.gguf
    3.82 GB
    LFS
    35542843fe71bdf872b0402445f983827f8800d0fd4326a714a7fd221c67c2de about 1 year ago
  • Experiment28M7-7B.Q3_K_M.gguf
    3.52 GB
    LFS
    cb60c9a810d7cd3078516e960c93c828eed87de3047827c008ad1cd8cc118629 about 1 year ago