Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
GSJL
/
Qwen2.5-32B-Instruct-GPTQ-Marlin
like
1
Text Generation
Transformers
Safetensors
qwen2
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
arxiv:
1910.09700
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Qwen2.5-32B-Instruct-GPTQ-Marlin
1 contributor
History:
3 commits
GSJL
Upload tokenizer
0cdaa96
verified
12 days ago
.gitattributes
1.52 kB
initial commit
12 days ago
README.md
5.17 kB
Upload tokenizer
12 days ago
added_tokens.json
605 Bytes
Upload of AutoGPTQ quantized model
12 days ago
config.json
1.03 kB
Upload of AutoGPTQ quantized model
12 days ago
merges.txt
1.67 MB
Upload of AutoGPTQ quantized model
12 days ago
model.safetensors
19.2 GB
LFS
Upload of AutoGPTQ quantized model
12 days ago
quantize_config.json
281 Bytes
Upload of AutoGPTQ quantized model
12 days ago
special_tokens_map.json
613 Bytes
Upload of AutoGPTQ quantized model
12 days ago
tokenizer_config.json
7.31 kB
Upload of AutoGPTQ quantized model
12 days ago
vocab.json
3.38 MB
Upload of AutoGPTQ quantized model
12 days ago