add chat_template
#7
by
ehartford
- opened
I am guessing, it needs chat_template in order to handle chat properly
Please check here
https://huggingface.co/mlx-community/dbrx-instruct-4bit/discussions/6
Better make sure this is correct, because I'm just guessing.
@ehartford it's already available, you need to add:
--use-default-chat-template
Example:
python -m mlx_lm.generate --model mlx-community/dbrx-instruct-4bit --prompt "What's the difference between PCA vs UMAP vs t-SNE?" --trust-remote-code --use-default-chat-template --max-tokens 1000
I will update the model card too.