mc0ps commited on
Commit
4085c90
1 Parent(s): 9ac9260

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -5
README.md CHANGED
@@ -6,13 +6,18 @@ license_name: deepseek-license
6
  license_link: LICENSE
7
  ---
8
 
9
- # deepseek-coder-6.7b-base-4bit-mlx
10
  This model was converted to MLX format from [`deepseek-ai/deepseek-coder-6.7b-base`]().
11
  Refer to the [original model card](https://huggingface.co/deepseek-ai/deepseek-coder-6.7b-base) for more details on the model.
12
  ## Use with mlx
 
13
  ```bash
14
- pip install mlx
15
- git clone https://github.com/ml-explore/mlx-examples.git
16
- cd mlx-examples/llms/hf_llm
17
- python generate.py --model mlx-community/deepseek-coder-6.7b-base-4bit-mlx --prompt "My name is"
 
 
 
 
18
  ```
 
6
  license_link: LICENSE
7
  ---
8
 
9
+ # mlx-community/deepseek-coder-6.7b-base-4bit-mlx
10
  This model was converted to MLX format from [`deepseek-ai/deepseek-coder-6.7b-base`]().
11
  Refer to the [original model card](https://huggingface.co/deepseek-ai/deepseek-coder-6.7b-base) for more details on the model.
12
  ## Use with mlx
13
+
14
  ```bash
15
+ pip install mlx-lm
16
+ ```
17
+
18
+ ```python
19
+ from mlx_lm import load, generate
20
+
21
+ model, tokenizer = load("mlx-community/deepseek-coder-6.7b-base-4bit-mlx")
22
+ response = generate(model, tokenizer, prompt="hello", verbose=True)
23
  ```