Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment27Neuralsirkrishna-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
4d5bdd1
Experiment27Neuralsirkrishna-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
ed0efb172f4e9859cccc16ec7bd5a6717c0078240b0f819ab7374cee6c501812
4d5bdd1
verified
3 months ago
.gitattributes
2.4 kB
ed0efb172f4e9859cccc16ec7bd5a6717c0078240b0f819ab7374cee6c501812
3 months ago
Experiment27Neuralsirkrishna-7B.IQ3_XS.gguf
3.02 GB
LFS
c001724238fb6def24424a5b7ffd3557fb3ee1f548ef9bf2269c769a520eb676
3 months ago
Experiment27Neuralsirkrishna-7B.IQ4_XS.gguf
3.94 GB
LFS
c5940bade9c6567af2ab47c57e2494c2caf6c57c2fae9a75980bafc58a41d95d
3 months ago
Experiment27Neuralsirkrishna-7B.Q2_K.gguf
2.72 GB
LFS
22cecf054ddea03e6b4f436cfcd5b9acbc5881959f2136b515608accc32b688f
3 months ago
Experiment27Neuralsirkrishna-7B.Q3_K_L.gguf
3.82 GB
LFS
33ccbd168be4dca9ed13ff2d2ea9b60a9416565ede5544bcea8df20b04269ff9
3 months ago
Experiment27Neuralsirkrishna-7B.Q3_K_M.gguf
3.52 GB
LFS
eee19b11d3793a5d4aeb49885aba888fead50d80ec65da4069f87b49517bc6cb
3 months ago
Experiment27Neuralsirkrishna-7B.Q3_K_S.gguf
3.16 GB
LFS
35ef5b7a7b91d14334b1ce3e174f16cea17ced5cf4046664837bfa9f1e68b421
3 months ago
Experiment27Neuralsirkrishna-7B.Q4_K_M.gguf
4.37 GB
LFS
31e43847a5664839e29d981c87fbcd7616e1ba5b15fb62b3cfb76c9bf7de0786
3 months ago
Experiment27Neuralsirkrishna-7B.Q4_K_S.gguf
4.14 GB
LFS
d3a48d80206a0be95c431a0c95c7d23ed98f1be766992b774db2d5c9881a2328
3 months ago
Experiment27Neuralsirkrishna-7B.Q5_K_M.gguf
5.13 GB
LFS
0ed19e6b8af3ef7cc58ced0b0a133829ffc1212b6768fe4410b42175fe8c23b0
3 months ago
Experiment27Neuralsirkrishna-7B.Q5_K_S.gguf
5 GB
LFS
9c743d1d3ee4bb99ffdedf72810508324970075cb88e71e338815bf4035c8fb9
3 months ago
Experiment27Neuralsirkrishna-7B.Q6_K.gguf
5.94 GB
LFS
ed0efb172f4e9859cccc16ec7bd5a6717c0078240b0f819ab7374cee6c501812
3 months ago
