Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2-7B-Instruct-GGUF
like
9
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama-3
llama
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
bf11543
Qwen2-7B-Instruct-GGUF
1 contributor
History:
5 commits
MaziyarPanahi
e28c4f05f7c746f3b5977e2d514b71fd81a7eb8224d59f5275e854c230038bd3
bf11543
verified
6 months ago
.gitattributes
1.78 kB
e28c4f05f7c746f3b5977e2d514b71fd81a7eb8224d59f5275e854c230038bd3
6 months ago
Qwen2-7B-Instruct.IQ1_M.gguf
2.04 GB
LFS
9e58b7c5d0b4d29ab66ca9f435a40b0a0ba886168b3480574a78565f7873fb05
6 months ago
Qwen2-7B-Instruct.IQ2_XS.gguf
2.47 GB
LFS
f04a6bde3f3f8d2d84cb5246003212b1be47f2fb344171d8bf30c77881667260
6 months ago
Qwen2-7B-Instruct.IQ3_XS.gguf
3.35 GB
LFS
3652b1f7837366ac52c96f7de535a868a66004447b1478baf7fecc8887d3a3c0
6 months ago
Qwen2-7B-Instruct.IQ4_XS.gguf
4.22 GB
LFS
e28c4f05f7c746f3b5977e2d514b71fd81a7eb8224d59f5275e854c230038bd3
6 months ago