xxx777xxxASD/ChaoticSoliloquy-4x8B
Text Generation
•
Updated
•
40
•
25
VISION, more stable but less creative
Note HF model
Note Q2_K, Q3_K_S, Q3_K_M, Q3_K_L, Q4_K_S, Q4_K_M, Q6_K, Q8_0 IQ3_S, IQ3_M Thanks for the quants!
Note Outdated GGUF Q5_K_S, Q4_K_S, Q3_K_L
Note Outdated GGUF Q3_K_M Thanks for the quant!
Note Outdated GGUF Q6_K Thanks for the quant!
Note Exl2: 6.0 bpw Thanks for the quant!
Note Exl2: 8.0 bpw Thanks for the quant!
Note Exl2: 8.0 bpw calibrated Thanks for the quant!
Note Exl2: 5.0 bpw calibrated Thanks for the quant!
Note Exl2: 6.0 bpw calibrated Thanks for the quant!
Note Exl2: 8.0 bpw calibrated Thanks for the quant!