Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Volko76
/
Qwen2.5-0.5B-Instruct-4.5bpw-exl2
like
0
Text Generation
Transformers
English
chat
autoquant
exl2
Inference Endpoints
arxiv:
2407.10671
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
a352389
Qwen2.5-0.5B-Instruct-4.5bpw-exl2
/
out_tensor
/
model.layers.12.self_attn.o_proj.safetensors
Commit History
Upload folder using huggingface_hub
a352389
verified
Volko76
commited on
about 1 month ago