tienhung36
/

vietcuna-7b-v3-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

vietcuna-7b-v3-AWQ / README.md

tienhung36's picture

Upload 7 files

f4200a0 verified 6 months ago

|

history blame contribute delete

109 Bytes

metadata

pipeline_tag: text-generation

"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM"