Jeyong
/

SOLAR-10.7B-dpo-v1-awq

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Edit model card

SOLAR-10.7B

Model Details

Base Model: hyeogi/SOLAR-10.7B-dpo-v1

Quantization

AWQ applied using following parameters.
- zero_point: True
- q_group_size: 128
- w_bit: 4
- version: GEMM

Downloads last month: 2

Safetensors

Model size

1.78B params

Tensor type

I32

·

FP16

·