Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Qwen
/
Qwen2.5-7B-Instruct-GGUF
like
109
Follow
Qwen
64.9k
Text Generation
GGUF
English
chat
conversational
arxiv:
2407.10671
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
7
Deploy
Use this model
main
Qwen2.5-7B-Instruct-GGUF
56.3 GB
2 contributors
History:
4 commits
feihu.hf
upload fp16 weights
bb5d59e
over 1 year ago
.gitattributes
1.56 kB
upload weights
over 1 year ago
LICENSE
11.3 kB
update README & LICENSE
over 1 year ago
README.md
5.63 kB
Update README.md
over 1 year ago
qwen2.5-7b-instruct-fp16-00001-of-00004.gguf
3.95 GB
xet
upload fp16 weights
over 1 year ago
qwen2.5-7b-instruct-fp16-00002-of-00004.gguf
3.86 GB
xet
upload fp16 weights
over 1 year ago
qwen2.5-7b-instruct-fp16-00003-of-00004.gguf
3.86 GB
xet
upload fp16 weights
over 1 year ago
qwen2.5-7b-instruct-fp16-00004-of-00004.gguf
3.56 GB
xet
upload fp16 weights
over 1 year ago
qwen2.5-7b-instruct-q2_k.gguf
3.02 GB
xet
upload weights
over 1 year ago
qwen2.5-7b-instruct-q3_k_m.gguf
3.81 GB
xet
upload weights
over 1 year ago
qwen2.5-7b-instruct-q4_0-00001-of-00002.gguf
3.98 GB
xet
upload weights
over 1 year ago
qwen2.5-7b-instruct-q4_0-00002-of-00002.gguf
448 MB
xet
upload weights
over 1 year ago
qwen2.5-7b-instruct-q4_k_m-00001-of-00002.gguf
3.99 GB
xet
upload weights
over 1 year ago
qwen2.5-7b-instruct-q4_k_m-00002-of-00002.gguf
690 MB
xet
upload weights
over 1 year ago
qwen2.5-7b-instruct-q5_0-00001-of-00002.gguf
4 GB
xet
upload weights
over 1 year ago
qwen2.5-7b-instruct-q5_0-00002-of-00002.gguf
1.31 GB
xet
upload weights
over 1 year ago
qwen2.5-7b-instruct-q5_k_m-00001-of-00002.gguf
3.99 GB
xet
upload weights
over 1 year ago
qwen2.5-7b-instruct-q5_k_m-00002-of-00002.gguf
1.45 GB
xet
upload weights
over 1 year ago
qwen2.5-7b-instruct-q6_k-00001-of-00002.gguf
3.95 GB
xet
upload weights
over 1 year ago
qwen2.5-7b-instruct-q6_k-00002-of-00002.gguf
2.3 GB
xet
upload weights
over 1 year ago
qwen2.5-7b-instruct-q8_0-00001-of-00003.gguf
3.98 GB
xet
upload weights
over 1 year ago
qwen2.5-7b-instruct-q8_0-00002-of-00003.gguf
3.94 GB
xet
upload weights
over 1 year ago
qwen2.5-7b-instruct-q8_0-00003-of-00003.gguf
176 MB
xet
upload weights
over 1 year ago