Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2.5-14B-Instruct-GGUF
like
1
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
263198e
Qwen2.5-14B-Instruct-GGUF
1 contributor
History:
9 commits
MaziyarPanahi
df55af329e2942fc594678c12825bf9b10f89fc71dfe7976df0d65bd7a777c12
263198e
verified
5 months ago
.gitattributes
2.07 kB
df55af329e2942fc594678c12825bf9b10f89fc71dfe7976df0d65bd7a777c12
5 months ago
Qwen2.5-14B-Instruct.IQ1_M.gguf
3.87 GB
LFS
58921dce9808db69c818cd7ef2253c92511b450bfb753a7429c463ced1ab6ad1
5 months ago
Qwen2.5-14B-Instruct.IQ1_S.gguf
3.61 GB
LFS
0fc28181d54f0c7a46c386019e0d243ca13e6c1a8cfa1176e31fb88c0bc0c66e
5 months ago
Qwen2.5-14B-Instruct.IQ2_XS.gguf
4.7 GB
LFS
440e7af9efadc0cae9aaea3a2b2d2437d81f0da04f89c9daea4fa9c4ff0768f7
5 months ago
Qwen2.5-14B-Instruct.IQ3_XS.gguf
6.38 GB
LFS
7c190992f9dfd49b8c22e7fbe87faadf151c9c81a6a55d6d04c3cd6c9c1e272d
5 months ago
Qwen2.5-14B-Instruct.IQ4_XS.gguf
8.12 GB
LFS
08d5eb66889a053a86a0e0fc5d4502660cfbbc0536a0e9c46e8fb409dbe26f34
5 months ago
Qwen2.5-14B-Instruct.Q2_K.gguf
5.77 GB
LFS
bd8d0650ee7da4375206c40ed1d9c545eb0628a84e5e67d5a3cc2c47ed338aa5
5 months ago
Qwen2.5-14B-Instruct.Q3_K_L.gguf
7.92 GB
LFS
5445187ee8d87cb1a5bcabba4803f0d5d07612275651abcab1f204cb1c0155e3
5 months ago
Qwen2.5-14B-Instruct.Q3_K_M.gguf
7.34 GB
LFS
df55af329e2942fc594678c12825bf9b10f89fc71dfe7976df0d65bd7a777c12
5 months ago
