ONS-AI-RESEARCH
/

ONS-SOLAR-10.7B-AWQ

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Edit model card

ONS-SOLAR-10.7B-AWQ

Model Details

Base Model: ONS-AI-RESEARCH/ONS-SOLAR-10.7B
Quantization by AutoAWQ(https://github.com/casper-hansen/AutoAWQ)

Downloads last month: 1

Safetensors

Model size

1.74B params

Tensor type

I32

·

FP16

·