File size: 622 Bytes
d6b8bd2 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 |
---
base_model: unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
language:
- en
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
- sft
- mlx
---
# gsegato/brevity-mlx
The Model [gsegato/brevity-mlx](https://huggingface.co/gsegato/brevity-mlx) was converted to MLX format from [gsegato/brevity](https://huggingface.co/gsegato/brevity) using mlx-lm version **0.16.1**.
## Use with mlx
```bash
pip install mlx-lm
```
```python
from mlx_lm import load, generate
model, tokenizer = load("gsegato/brevity-mlx")
response = generate(model, tokenizer, prompt="hello", verbose=True)
```
|