Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
mathstral-7B-v0.1-GGUF
like
7
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
2bc5582
mathstral-7B-v0.1-GGUF
1 contributor
History:
17 commits
MaziyarPanahi
dcdff5cb5ac679e82e0361e03ab2bd7da3b2e406dfb977e713ba58f141a2d288
2bc5582
verified
5 months ago
.gitattributes
Safe
2.64 kB
dcdff5cb5ac679e82e0361e03ab2bd7da3b2e406dfb977e713ba58f141a2d288
5 months ago
README.md
Safe
2.96 kB
e266546623f45eb0851454548503ced1edac6b425be9ee7151cbde1c7713e560
5 months ago
mathstral-7B-v0.1-GGUF_imatrix.dat
Safe
4.99 MB
LFS
e266546623f45eb0851454548503ced1edac6b425be9ee7151cbde1c7713e560
5 months ago
mathstral-7B-v0.1.IQ1_M.gguf
Safe
1.76 GB
LFS
e266546623f45eb0851454548503ced1edac6b425be9ee7151cbde1c7713e560
5 months ago
mathstral-7B-v0.1.IQ1_S.gguf
Safe
1.62 GB
LFS
dcdff5cb5ac679e82e0361e03ab2bd7da3b2e406dfb977e713ba58f141a2d288
5 months ago
mathstral-7B-v0.1.IQ2_XS.gguf
Safe
2.2 GB
LFS
51e712a3b42d83d2305637b3b3fdb69e0653579d22a71457a78ccd4efe4d7533
5 months ago
mathstral-7B-v0.1.IQ3_XS.gguf
Safe
3.02 GB
LFS
92137493a565dd1182d49f411e1c09d8cd36d8f422ae275b77ebdcd6c277ca68
5 months ago
mathstral-7B-v0.1.IQ4_XS.gguf
Safe
3.91 GB
LFS
8e312857bf506dddea88e468002363a2959455979035c17d1f9c9d999d016d8c
5 months ago
mathstral-7B-v0.1.Q2_K.gguf
Safe
2.72 GB
LFS
fe85905d7dda85fb7b35c11945ff2278c89bb5e45d4201d7c748084ecf501f8e
5 months ago
mathstral-7B-v0.1.Q3_K_L.gguf
Safe
3.83 GB
LFS
78c544e2e2fddd93566f2eb240b61f71b061c75b47ab3ea872c44cf439db329a
5 months ago
mathstral-7B-v0.1.Q3_K_M.gguf
Safe
3.52 GB
LFS
1cda21ccaf2fa0054c116e9ee618ff3c1f5b19c9a9bc5df0b5d94e381091e220
5 months ago
mathstral-7B-v0.1.Q3_K_S.gguf
Safe
3.17 GB
LFS
477888e037f7ec764687f643c9793794a3f5477a210ef9b0eccd7a3ad693e2ab
5 months ago
mathstral-7B-v0.1.Q4_K_M.gguf
Safe
4.37 GB
LFS
633cbb0385c0e7eb348f3cbf09138447b3e5ad5701a7685ff25dd21be9f8a6df
5 months ago
mathstral-7B-v0.1.Q4_K_S.gguf
Safe
4.14 GB
LFS
9e146b2594990ba200bf525162ab3ab02b4424c192965a03fe55a9236e137b9c
5 months ago
mathstral-7B-v0.1.Q5_K_M.gguf
Safe
5.14 GB
LFS
61a081442fb25db71bc795a966ab2319612ac9769c924a0d3121526ba94f0491
5 months ago
mathstral-7B-v0.1.Q5_K_S.gguf
Safe
5 GB
LFS
bde366ded56e73059de56eb90b1c4b80abfc5bfa5d5fd3877c7370cdca1de47b
5 months ago
mathstral-7B-v0.1.Q6_K.gguf
Safe
5.95 GB
LFS
7cc1e04003720ca860de76d5a3cf0e6385f850c05c073a6a859158351af07b62
5 months ago
mathstral-7B-v0.1.Q8_0.gguf
Safe
7.7 GB
LFS
8a2c4bc08c7355234ed23358655f24d90bf2e95c6cd7222dd7f358f826454751
5 months ago
mathstral-7B-v0.1.fp16.gguf
Safe
14.5 GB
LFS
e5f74241ffdb4741699724f33b78cc364cbd2e586d2f8c92dd6d0cb3e517bf45
5 months ago
