MLX Community org

I am guessing, it needs chat_template in order to handle chat properly

MLX Community org

Please check here

Better make sure this is correct, because I'm just guessing.

MLX Community org

@ehartford it's already available, you need to add:



python -m mlx_lm.generate --model mlx-community/dbrx-instruct-4bit --prompt "What's the difference between PCA vs UMAP vs t-SNE?" --trust-remote-code --use-default-chat-template  --max-tokens 1000

I will update the model card too.

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment