6.0bpw EXL2 quant for https://huggingface.co/ProdeusUnity/Stellar-Odyssey-12b-adventure-v0.0

8bit head weights. Default measurement dataset used.

Downloads last month
6
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.