lazarustda
commited on
Commit
•
1ece0a8
1
Parent(s):
fb9d4ad
Update README.md
Browse files
README.md
CHANGED
@@ -17,7 +17,7 @@ extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review
|
|
17 |
extra_gated_button_content: Acknowledge license
|
18 |
---
|
19 |
|
20 |
-
# mlx-community/gemma-1.1-7b-it
|
21 |
This model was converted to MLX format from [`google/gemma-1.1-7b-it`]() using mlx-lm version **0.7.0**.
|
22 |
Refer to the [original model card](https://huggingface.co/google/gemma-1.1-7b-it) for more details on the model.
|
23 |
## Use with mlx
|
@@ -29,6 +29,6 @@ pip install mlx-lm
|
|
29 |
```python
|
30 |
from mlx_lm import load, generate
|
31 |
|
32 |
-
model, tokenizer = load("mlx-community/gemma-1.1-7b-it")
|
33 |
response = generate(model, tokenizer, prompt="hello", verbose=True)
|
34 |
```
|
|
|
17 |
extra_gated_button_content: Acknowledge license
|
18 |
---
|
19 |
|
20 |
+
# mlx-community/gemma-1.1-7b-it-4bit
|
21 |
This model was converted to MLX format from [`google/gemma-1.1-7b-it`]() using mlx-lm version **0.7.0**.
|
22 |
Refer to the [original model card](https://huggingface.co/google/gemma-1.1-7b-it) for more details on the model.
|
23 |
## Use with mlx
|
|
|
29 |
```python
|
30 |
from mlx_lm import load, generate
|
31 |
|
32 |
+
model, tokenizer = load("mlx-community/gemma-1.1-7b-it-4bit")
|
33 |
response = generate(model, tokenizer, prompt="hello", verbose=True)
|
34 |
```
|