|
--- |
|
library_name: xtuner |
|
tags: |
|
- mlx |
|
datasets: |
|
- Lin-Chen/ShareGPT4V |
|
pipeline_tag: image-text-to-text |
|
--- |
|
|
|
# mlx-community/llava-llama-3-8b-v1_1-8bit |
|
This model was converted to MLX format from [`xtuner/llava-llama-3-8b-v1_1-transformers`]() using mlx-vllm version **0.0.3**. |
|
Refer to the [original model card](https://huggingface.co/xtuner/llava-llama-3-8b-v1_1-transformers) for more details on the model. |
|
## Use with mlx |
|
|
|
```bash |
|
pip install -U mlx-vlm |
|
``` |
|
|
|
```bash |
|
python -m mlx_vlm.generate --model mlx-community/llava-llama-3-8b-v1_1-8bit --max-tokens 100 --temp 0.0 |
|
``` |
|
|
