File size: 476 Bytes
46e4d81 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
---
tags:
- vision
- image-text-to-text
- mlx
---
# mlx-community/llava-v1.6-34b-4bit
This model was converted to MLX format from [`llava-hf/llava-v1.6-34b-hf`]() using mlx-vlm version **0.0.9**.
Refer to the [original model card](https://huggingface.co/llava-hf/llava-v1.6-34b-hf) for more details on the model.
## Use with mlx
```bash
pip install -U mlx-vlm
```
```bash
python -m mlx_vlm.generate --model mlx-community/llava-v1.6-34b-4bit --max-tokens 100 --temp 0.0
```
|