Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Percival_01M7-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Percival_01M7-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
9f9c067838607af3ffeea9c4af2b64fc035f4d1aedd72ae7bca0da6054f88c34
7dc8bd4
verified
2 months ago
.gitattributes
2.23 kB
8e1208260285aa39e017d6b40dcde84724ea3ddbb56d3502c8c2ccab0f06295d
2 months ago
Percival_01M7-7B.Q2_K.gguf
2.72 GB
LFS
88b045e32736f35a98635e1794eceb6d0c43a7d40d8e36fb82abe964ee5612f8
2 months ago
Percival_01M7-7B.Q3_K_L.gguf
3.82 GB
LFS
0ab8ed92414fbe4e872bd7f37dc657d82b5120d28dc7b02b96eba4b3c151ca15
2 months ago
Percival_01M7-7B.Q3_K_M.gguf
3.52 GB
LFS
f947b5fc4017040076497e60eff81eab3d8e13a9444086afd83bddae5a8493de
2 months ago
Percival_01M7-7B.Q3_K_S.gguf
3.16 GB
LFS
fc28dd497a612a8060abb6ace9a5f8f2acb55d0cc298f7ee43ed2302257fa13f
2 months ago
Percival_01M7-7B.Q4_K_M.gguf
4.37 GB
LFS
c9ab574c3e8f9717e0e66d90ed6e46a7d06ed88b7084c352bfc8833c84c861ef
2 months ago
Percival_01M7-7B.Q4_K_S.gguf
4.14 GB
LFS
36f91df4a361ebb1ed167962999f445a2215fce47373c9597ddd94ecb057243a
2 months ago
Percival_01M7-7B.Q5_K_M.gguf
5.13 GB
LFS
5c6ac3016a400b053c023ac58f1e9052707ec3de07be1319d8d649e63a372f5e
2 months ago
Percival_01M7-7B.Q5_K_S.gguf
5 GB
LFS
a970f459a1438cc599e9635669fe94272e98eeb53f694922741d5c5dacd47374
2 months ago
Percival_01M7-7B.Q6_K.gguf
5.94 GB
LFS
1a61b25f0f5ae71ba22e2d22da8b6ccb992aa71128ad9205854b2665b47fce93
2 months ago
Percival_01M7-7B.Q8_0.gguf
7.7 GB
LFS
707161cdfaff214a0e8abe061f235a53a10f7334afc393c7f0f5e8a9e8e69efa
2 months ago
Percival_01M7-7B.fp16.gguf
14.5 GB
LFS
8e1208260285aa39e017d6b40dcde84724ea3ddbb56d3502c8c2ccab0f06295d
2 months ago
README.md
3.18 kB
9f9c067838607af3ffeea9c4af2b64fc035f4d1aedd72ae7bca0da6054f88c34
2 months ago
