YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
A Moe model built on top of Qwen1.5-7B-Chat, Qwen1.5-7B and Crystalcareai/CrystalQwen-1.5-7B, then qlora via mlx
pip install mlx-moe
python -m mlx_moe.generate --model mzbac/qwen-1.5-2x3-sft-hf-4bit-mlx --prompt "how backpropagation works?" --eos-token "<|im_end|>"
- Downloads last month
- 7
This model does not have enough activity to be deployed to Inference API (serverless) yet.
Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.