Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2-7B-Instruct-GGUF
like
7
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama-3
llama
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
c551493
Qwen2-7B-Instruct-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
9a99dd6d203734faaba580e657e1fa2276cdecdc5210aa9331d57dff5a83dbe7
c551493
verified
5 months ago
.gitattributes
Safe
1.98 kB
9a99dd6d203734faaba580e657e1fa2276cdecdc5210aa9331d57dff5a83dbe7
5 months ago
Qwen2-7B-Instruct.IQ1_M.gguf
Safe
2.04 GB
LFS
9e58b7c5d0b4d29ab66ca9f435a40b0a0ba886168b3480574a78565f7873fb05
5 months ago
Qwen2-7B-Instruct.IQ2_XS.gguf
Safe
2.47 GB
LFS
f04a6bde3f3f8d2d84cb5246003212b1be47f2fb344171d8bf30c77881667260
5 months ago
Qwen2-7B-Instruct.IQ3_XS.gguf
Safe
3.35 GB
LFS
3652b1f7837366ac52c96f7de535a868a66004447b1478baf7fecc8887d3a3c0
5 months ago
Qwen2-7B-Instruct.IQ4_XS.gguf
Safe
4.22 GB
LFS
e28c4f05f7c746f3b5977e2d514b71fd81a7eb8224d59f5275e854c230038bd3
5 months ago
Qwen2-7B-Instruct.Q2_K.gguf
Safe
3.02 GB
LFS
3f9718ea0f926f6953cfe543f0d00f200c35ce05ed2835b8bca4adb9c4e2fc86
5 months ago
Qwen2-7B-Instruct.Q3_K_L.gguf
Safe
4.09 GB
LFS
e401f648ae9014eac55afaf2b6c8e26499402838f7a3b38642e8a7d7091c0981
5 months ago
Qwen2-7B-Instruct.Q3_K_M.gguf
Safe
3.81 GB
LFS
9a99dd6d203734faaba580e657e1fa2276cdecdc5210aa9331d57dff5a83dbe7
5 months ago
