Configuration Parsing Warning:In config.json: "quantization_config.bits" must be an integer

3BPW EXL3 quant of Nex-N2-Pro 397B.

 -- A perplexity:  3.27149435
 -- B perplexity:  3.33366150
 -- A label in top-K:
      K = 1: 0.7134
      K = 2: 0.8113
      K = 3: 0.8533
      K = 4: 0.8768
      K = 5: 0.8925
 -- B label in top-K:
      K = 1: 0.7087
      K = 2: 0.8089
      K = 3: 0.8510
      K = 4: 0.8751
      K = 5: 0.8911
 -- Top-K agreement, A vs B:
      K = 1: 0.9340
      K = 2: 0.7508
      K = 3: 0.5420
      K = 4: 0.3625
      K = 5: 0.2308
 -- KL divergence (A, B):  0.05224654
 -- KL divergence (B, A):  0.04909933
Downloads last month
27
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for cpral/Nex-N2-Pro-EXL3-3bpw

Quantized
(17)
this model