MLX 8 bpw quantization for Cydonia 24B v2.1
Says it on the tin.
Original model card:
Join our Discord! https://discord.gg/Nbv9pQ88Xb
Nearly 5000 members strong 💪 Now with more channels! A hub for users and makers alike!
BeaverAI proudly presents...
Cydonia 24B v2.1 💿
Special Thanks
- Thank you to each and everyone who donated and subscribed in Ko-Fi to make our venture a little bit easier.
- I'm also recently unemployed. I am a Software Developer with 8 years of experience in Web, API, AI, and adapting to new tech and requirements. If you're hiring, feel free to reach out to me however.
Supported Chat Templates
- Mistral v7 Tekken (recommended)
- Metharme (may require some patching)
- Alpaca (worth a try for story)
Description
Cydonia 24B v2.1 is a finetune of Mistral's latest 'Small' model (2501).
Further tuning was done to improve prose, foster creativity, and tone down positivity.
Links
- Downloads last month
- 9
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no library tag.