Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Anthonyg5005
/
Qwen1.5-0.5B-Chat-exl2
like
0
Text Generation
English
ExLlamaV2
chat
License:
tongyi-qianwen-research (other)
Model card
Files
Files and versions
Community
Edit model card
Exl2 quants for Qwen1.5-0.5B-Chat
Automatically quantized using the auto quant script from hf-scripts
BPW:
Exl2 quants for
Qwen1.5-0.5B-Chat
Automatically quantized using the auto quant script from
hf-scripts
Created as an example for
Auto EXL2 HF upload
BPW:
2.0
2.5
3.0
3.5
4.0
4.5
5.0
5.5
6.0
measurement.json
Downloads last month
-
Downloads are not tracked for this model.
How to track
Inference Examples
Text Generation
Inference API (serverless) does not yet support ExLlamaV2 models for this pipeline type.
Maximize