6bpw exl2 quant of: https://huggingface.co/Steelskull/MSM-MS-Cydrion-22B
MSM-MS-Cydrion-22B
Meet Cydrion, the attempt of fusion for creativity and intelligence.
Creator: SteelSkull
About Cydrion-22B:
Name Legend:
MSM = Mistral-Small
MS = Model Stock
22b = its 22b
This model merges the robust storytelling of Cydonia with the creative edge of Acolyte, ArliAI-RPMax, and Gutenberg with some special sauce.
Use Mistral Format
Quants:
My Quants:MSM-MS-Cydrion-22B-Q6_K-GGUF
Config:
MODEL_NAME = "MSM-MS-Cydrion-22B"
yaml_config = """
base_model: Steelskull/Merged-v2
merge_method: model_stock
dtype: bfloat16
models:
- model: TheDrummer/Cydonia-22B-v1.1
- model: ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1
- model: nbeerbower/Mistral-Small-Gutenberg-Doppel-22B
- model: rAIfle/Acolyte-22B
"""
If you wish to support:
- Downloads last month
- 7
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for Jellon/MSM-MS-Cydrion-22B-exl2-6bpw
Base model
Steelskull/MSM-MS-Cydrion-22B