bigquant/Senku-70B-AWQ-4bit-GEMM

A quantized version of Shinoji Research's Senku 70B Full. Quantized through AWQ:

Quantization settings:

{"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }