mc0ps commited on
Commit
e04ac03
1 Parent(s): 89b29c2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -5
README.md CHANGED
@@ -10,13 +10,18 @@ license_name: deepseek
10
  pipeline_tag: text-generation
11
  ---
12
 
13
- # Magicoder-S-DS-6.7B-4bit-mlx
14
  This model was converted to MLX format from [`ise-uiuc/Magicoder-S-DS-6.7B`]().
15
  Refer to the [original model card](https://huggingface.co/ise-uiuc/Magicoder-S-DS-6.7B) for more details on the model.
16
  ## Use with mlx
 
17
  ```bash
18
- pip install mlx
19
- git clone https://github.com/ml-explore/mlx-examples.git
20
- cd mlx-examples/llms/hf_llm
21
- python generate.py --model mlx-community/Magicoder-S-DS-6.7B-4bit-mlx --prompt "My name is"
 
 
 
 
22
  ```
 
10
  pipeline_tag: text-generation
11
  ---
12
 
13
+ # mlx-community/Magicoder-S-DS-6.7B-4bit-mlx
14
  This model was converted to MLX format from [`ise-uiuc/Magicoder-S-DS-6.7B`]().
15
  Refer to the [original model card](https://huggingface.co/ise-uiuc/Magicoder-S-DS-6.7B) for more details on the model.
16
  ## Use with mlx
17
+
18
  ```bash
19
+ pip install mlx-lm
20
+ ```
21
+
22
+ ```python
23
+ from mlx_lm import load, generate
24
+
25
+ model, tokenizer = load("mlx-community/Magicoder-S-DS-6.7B-4bit-mlx")
26
+ response = generate(model, tokenizer, prompt="hello", verbose=True)
27
  ```