Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment28Neuralsirkrishna-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
8c7cc89
Experiment28Neuralsirkrishna-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
b9c1b7fe5859ba5768a86e960c72e48521512a19ba3ce0e3969ece337a806bca
8c7cc89
verified
5 months ago
.gitattributes
2.4 kB
7e34e0305e8da6660991396773a2189324c83f9acf3a5bbd3124e6c62ee0993d
5 months ago
Experiment28Neuralsirkrishna-7B.IQ3_XS.gguf
3.02 GB
LFS
5d28a30458d7c86b11358fc128cd9c439f0f9f5b104038ab8454c5aec8d61a6f
5 months ago
Experiment28Neuralsirkrishna-7B.IQ4_XS.gguf
3.94 GB
LFS
cc629a76ab750167a89fd08a98b70b97850bbc14322d51c808bae967e847fa34
5 months ago
Experiment28Neuralsirkrishna-7B.Q2_K.gguf
2.72 GB
LFS
feebe946127899b0f421f75f036f9777d833a4c40dc6d7bfab07d90066dfcf45
5 months ago
Experiment28Neuralsirkrishna-7B.Q3_K_L.gguf
3.82 GB
LFS
39567cf292974d2d0571100efc134ec9a67c439ed94dc3b381245a48f5d56843
5 months ago
Experiment28Neuralsirkrishna-7B.Q3_K_M.gguf
3.52 GB
LFS
91147257bfe6e77630f189e752fc90d1c89c7fd601a628bc69b59f1f12797dd0
5 months ago
Experiment28Neuralsirkrishna-7B.Q3_K_S.gguf
3.16 GB
LFS
10b404582169787ddcc257ec9ead2e21530e395f512b556e5767a3c6ce5c30c2
5 months ago
Experiment28Neuralsirkrishna-7B.Q4_K_M.gguf
4.37 GB
LFS
f29f4503722446df3bf5b69f5d96f0b38e85b3688185149654a7f5930e997d1f
5 months ago
Experiment28Neuralsirkrishna-7B.Q4_K_S.gguf
4.14 GB
LFS
288b2a6dd5ed20b840c0c33be36c01c57951a81cd4b84ab6c7c619871452625d
5 months ago
Experiment28Neuralsirkrishna-7B.Q5_K_M.gguf
5.13 GB
LFS
62e5d3e5aad9150f4c4eda59318b304823f286a36421af7d087639a42335c1f7
5 months ago
Experiment28Neuralsirkrishna-7B.Q5_K_S.gguf
5 GB
LFS
5f6c3969cb307a917c5a950291cbab591a3c42817181229319aa03aaff78a24b
5 months ago
Experiment28Neuralsirkrishna-7B.Q6_K.gguf
5.94 GB
LFS
7e34e0305e8da6660991396773a2189324c83f9acf3a5bbd3124e6c62ee0993d
5 months ago
README.md
11.2 kB
b9c1b7fe5859ba5768a86e960c72e48521512a19ba3ce0e3969ece337a806bca
5 months ago