Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Inex12Yamshadow-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Inex12Yamshadow-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
b5a250c3548edd6c51487ad63ba57794ea8e3b012471057b2a41dc4de8201144
5cdfa81
verified
6 months ago
.gitattributes
2.25 kB
3d5dd88f74a876af42e05ac22469413ad626c949c34bd2d4ffa9f2ee2be7314d
6 months ago
Inex12Yamshadow-7B.IQ3_XS.gguf
3.02 GB
LFS
9a40ea893655532a2639e9f9c76fc55bffc63db29747a2ba89af4c95ea54c5c4
6 months ago
Inex12Yamshadow-7B.IQ4_XS.gguf
3.94 GB
LFS
dc93adb3b17911b8a3f42edaddb3af970c436ae51130dec40b63ce990cb49079
6 months ago
Inex12Yamshadow-7B.Q2_K.gguf
2.72 GB
LFS
0d0c224472a5eb0822b0e90d5baf23ad847a9b4d47e5a4abc1244cee1299a9da
6 months ago
Inex12Yamshadow-7B.Q3_K_L.gguf
3.82 GB
LFS
215dafecd35b65ecb527582983464abded0329ee87bc6a8183e10709deb1671e
6 months ago
Inex12Yamshadow-7B.Q3_K_M.gguf
3.52 GB
LFS
fb76046500d38b0c7b180a3075cb5ee6c0e3bda9534a88bf34e45a2a1c560476
6 months ago
Inex12Yamshadow-7B.Q3_K_S.gguf
3.16 GB
LFS
817deb9e00837b3ed08658923193886e691ffe960cce531d7c17d3da6b182657
6 months ago
Inex12Yamshadow-7B.Q4_K_M.gguf
4.37 GB
LFS
bdd570a5fde62b622a04fc38bc183883dd303099d86490c75faafc42c58e832d
6 months ago
Inex12Yamshadow-7B.Q4_K_S.gguf
4.14 GB
LFS
59ba0f7db70a4d67c696e7feaf351ca1f1e961c864714ab5b170c6af65670331
6 months ago
Inex12Yamshadow-7B.Q5_K_M.gguf
5.13 GB
LFS
83859d8f8e30e509ff22132948fbe05893d407f325f336a102c0af46a69ba16c
6 months ago
Inex12Yamshadow-7B.Q5_K_S.gguf
5 GB
LFS
d849e7aea0e03e7805ca89aa69a76b705fc6830ae2bb565605c0c5bc80d70511
6 months ago
Inex12Yamshadow-7B.Q6_K.gguf
5.94 GB
LFS
3d5dd88f74a876af42e05ac22469413ad626c949c34bd2d4ffa9f2ee2be7314d
6 months ago
README.md
11 kB
b5a250c3548edd6c51487ad63ba57794ea8e3b012471057b2a41dc4de8201144
6 months ago
