Lets Make it Clear its a 2x3B MoE : Pretrained on Context Obedience, Python, Mermaids, Chain Of Thought

Base Model ~ Pretrained with a variety of python, mermaid diagrams, context obedient, some uncensored dealignment, and a little bit of chain of thought

This is not an instruct tuned model so treat it like an auto complete until further instruction tuning is added

Outputs can be unpredictable as this model was tuned to be unaligned to be flexible in the range of what it can be tuned to.

Downloads last month
5
Safetensors
Model size
5.86B params
Tensor type
BF16
·
Inference API
Unable to determine this model's library. Check the docs .