bibproj commited on
Commit
52b5201
·
verified ·
1 Parent(s): a0de11d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +33 -1
README.md CHANGED
@@ -1,5 +1,37 @@
1
  ---
 
2
  license: mit
 
 
 
3
  base_model:
4
  - inclusionAI/Ling-1T
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ library_name: mlx
3
  license: mit
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - mlx
7
  base_model:
8
  - inclusionAI/Ling-1T
9
+ ---
10
+
11
+ # mlx-community/Ling-1T-mlx-3bit/
12
+
13
+ This model [mlx-community/Ling-1T-mlx-3bit/](https://huggingface.co/mlx-community/Ling-1T-mlx-3bit/) was
14
+ converted to MLX format from [zai-org/GLM-4.6](https://huggingface.co/inclusionAI/Ling-1T)
15
+ using mlx-lm version **0.28.1**.
16
+
17
+ ## Use with mlx
18
+
19
+ ```bash
20
+ pip install mlx-lm
21
+ ```
22
+
23
+ ```python
24
+ from mlx_lm import load, generate
25
+
26
+ model, tokenizer = load("mlx-community/Ling-1T-mlx-3bit/")
27
+
28
+ prompt = "hello"
29
+
30
+ if tokenizer.chat_template is not None:
31
+ messages = [{"role": "user", "content": prompt}]
32
+ prompt = tokenizer.apply_chat_template(
33
+ messages, add_generation_prompt=True
34
+ )
35
+
36
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
37
+ ```