"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM"
- Downloads last month
- 10
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM"