Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment26Percival_01-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Experiment26Percival_01-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
a3487932dba1bc795335b0c92b7478de11601c2d8661a0e2b85b0d1e3dac805a
82c884f
verified
7 months ago
.gitattributes
2.34 kB
19810189c2305a91fba68dbd92d0ae2c262adc4864ffe5684f6c07b9289ecf40
7 months ago
Experiment26Percival_01-7B.Q2_K.gguf
2.72 GB
LFS
207ca5fa0550a2aa7ea240ec8ddb99ee05774b4625039d01241e79966698b37a
7 months ago
Experiment26Percival_01-7B.Q3_K_L.gguf
3.82 GB
LFS
050d02dec4ede65adcbee87871d5e1e70b250a455824fa6381ce2a9b2d81814d
7 months ago
Experiment26Percival_01-7B.Q3_K_M.gguf
3.52 GB
LFS
bcd6385223c7dafd93a9702684f179ec35432faf41d3ab897f11965ffa40f059
7 months ago
Experiment26Percival_01-7B.Q3_K_S.gguf
3.16 GB
LFS
28aef556e38a6408fd3f1c7c375f7c3bb5bc2987debe15321a8b7f4d2c93a8de
7 months ago
Experiment26Percival_01-7B.Q4_K_M.gguf
4.37 GB
LFS
fbc61dbfbab560e9175898e6ba0bb0dbdbb07188777a8b6982fd4e15df714a01
7 months ago
Experiment26Percival_01-7B.Q4_K_S.gguf
4.14 GB
LFS
32cdd563ff17887d731d4cb4594a415439141c8d78ed6799b3a1ce6e07e28ea3
7 months ago
Experiment26Percival_01-7B.Q5_K_M.gguf
5.13 GB
LFS
11d8f4500871fb348fe049f808a0776147fb96785dd3a9ad473adc950ff0fb13
7 months ago
Experiment26Percival_01-7B.Q5_K_S.gguf
5 GB
LFS
07ebb3cb98dd246959afb1ee4fcefea8144e436bde048567602ccf96b592f34e
7 months ago
Experiment26Percival_01-7B.Q6_K.gguf
5.94 GB
LFS
2647fc4ac81fcdeb60de97682ddc11f91ecae87f03457764489ddef6317e65f6
7 months ago
Experiment26Percival_01-7B.Q8_0.gguf
7.7 GB
LFS
9541dfd7a95f7bb57bf283f70992f80d01ec95403160035a63a089d3b039a493
7 months ago
Experiment26Percival_01-7B.fp16.gguf
14.5 GB
LFS
19810189c2305a91fba68dbd92d0ae2c262adc4864ffe5684f6c07b9289ecf40
7 months ago
README.md
3.25 kB
a3487932dba1bc795335b0c92b7478de11601c2d8661a0e2b85b0d1e3dac805a
7 months ago