Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
NeuralsirkrishnaT3qm7x-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
NeuralsirkrishnaT3qm7x-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
2facfc6ecea983058a849ed25f4210dd3cd8354552ade56ba3caac1d2b48081b
9ec574b
verified
5 months ago
.gitattributes
2.33 kB
23632f14a0c59a3c2a548c139a6b4f61c7a56e2d98bcd8f5b11500db4dacfe9c
5 months ago
NeuralsirkrishnaT3qm7x-7B.IQ3_XS.gguf
3.02 GB
LFS
378792362bab04108d18ddc0c778129cf6d9c1705ac486e2dbbccd20284ae3d6
5 months ago
NeuralsirkrishnaT3qm7x-7B.IQ4_XS.gguf
3.94 GB
LFS
a39200242f0233c532a5e9c67580ebba97a936b1d1bd3fb08d9054728f510b79
5 months ago
NeuralsirkrishnaT3qm7x-7B.Q2_K.gguf
2.72 GB
LFS
519da40c239c5a8117fd60d7c0674f2ac0e9956874047337f84fdfe75acdaff2
5 months ago
NeuralsirkrishnaT3qm7x-7B.Q3_K_L.gguf
3.82 GB
LFS
d503ae49c394a607f69037868a3b39cc48c6c0624403a3254f67abfc843e70d5
5 months ago
NeuralsirkrishnaT3qm7x-7B.Q3_K_M.gguf
3.52 GB
LFS
ebb46a75d748b85b06c126deb6f714e3ea58ceaf359653108ede26c5960af850
5 months ago
NeuralsirkrishnaT3qm7x-7B.Q3_K_S.gguf
3.16 GB
LFS
3ae826d1a3a9b3b30ec07743d5c410dc7d5ab14275dec4c10d610c553e73cc9c
5 months ago
NeuralsirkrishnaT3qm7x-7B.Q4_K_M.gguf
4.37 GB
LFS
6ff863fd682f294040860847f3f1df2c46010c2fa63d1d558858b72b1b53a826
5 months ago
NeuralsirkrishnaT3qm7x-7B.Q4_K_S.gguf
4.14 GB
LFS
df3eabac539872124a35bfe33439d0ee59c27df1949c70b5a83c0db0168523df
5 months ago
NeuralsirkrishnaT3qm7x-7B.Q5_K_M.gguf
5.13 GB
LFS
d077f0c63b712a0a8ab6ef13fad4c8ff129638020425b2453ec2738b933032e6
5 months ago
NeuralsirkrishnaT3qm7x-7B.Q5_K_S.gguf
5 GB
LFS
74d78ea782c62a1932cf98682ff94cbf90357f430a08a6acf6d5671bd60f0a8a
5 months ago
NeuralsirkrishnaT3qm7x-7B.Q6_K.gguf
5.94 GB
LFS
23632f14a0c59a3c2a548c139a6b4f61c7a56e2d98bcd8f5b11500db4dacfe9c
5 months ago
README.md
11.1 kB
2facfc6ecea983058a849ed25f4210dd3cd8354552ade56ba3caac1d2b48081b
5 months ago
