MLX
mistral
mc0ps commited on
Commit
dcc0435
1 Parent(s): d848499

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -5
README.md CHANGED
@@ -30,13 +30,18 @@ datasets:
30
  - allenai/ultrafeedback_binarized_cleaned
31
  ---
32
 
33
- # bagel-dpo-7b-v0.1-4bit-mlx
34
  This model was converted to MLX format from [`jondurbin/bagel-dpo-7b-v0.1`]().
35
  Refer to the [original model card](https://huggingface.co/jondurbin/bagel-dpo-7b-v0.1) for more details on the model.
36
  ## Use with mlx
 
37
  ```bash
38
- pip install mlx
39
- git clone https://github.com/ml-explore/mlx-examples.git
40
- cd mlx-examples/llms/hf_llm
41
- python generate.py --model mlx-community/bagel-dpo-7b-v0.1-4bit-mlx --prompt "My name is"
42
  ```
 
 
 
 
 
 
 
 
30
  - allenai/ultrafeedback_binarized_cleaned
31
  ---
32
 
33
+ # mlx-community/bagel-dpo-7b-v0.1-4bit-mlx
34
  This model was converted to MLX format from [`jondurbin/bagel-dpo-7b-v0.1`]().
35
  Refer to the [original model card](https://huggingface.co/jondurbin/bagel-dpo-7b-v0.1) for more details on the model.
36
  ## Use with mlx
37
+
38
  ```bash
39
+ pip install mlx-lm
 
 
 
40
  ```
41
+
42
+ ```python
43
+ from mlx_lm import load, generate
44
+
45
+ model, tokenizer = load("mlx-community/bagel-dpo-7b-v0.1-4bit-mlx")
46
+ response = generate(model, tokenizer, prompt="hello", verbose=True)
47
+ ```