| language: | |
| - vi | |
| license: afl-3.0 | |
| library_name: transformers | |
| tags: | |
| - LLMs | |
| - NLP | |
| - Vietnamese | |
| - Large Language Models | |
| - mlx | |
| extra_gated_prompt: You agree not to use the model for experiments that could harm | |
| human subjects. | |
| extra_gated_fields: | |
| Name: text | |
| Email: text | |
| Affiliation: text | |
| Country: text | |
| I agree to the LICENSE of this model: checkbox | |
| # Viet-Mistral/Vistral-7B-Chat-mlx-4bit | |
| This model was converted to MLX format from [`Viet-Mistral/Vistral-7B-Chat`](). | |
| Refer to the [original model card](https://huggingface.co/Viet-Mistral/Vistral-7B-Chat) for more details on the model. | |
| ## Use with mlx | |
| ```bash | |
| pip install mlx-lm | |
| ``` | |
| ```python | |
| from mlx_lm import load, generate | |
| model, tokenizer = load("Viet-Mistral/Vistral-7B-Chat-mlx-4bit") | |
| response = generate(model, tokenizer, prompt="hello", verbose=True) | |
| ``` | |