KYUNGYONG commited on
Commit
1491233
·
verified ·
1 Parent(s): 177b3fe

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +74 -0
README.md ADDED
@@ -0,0 +1,74 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: open-neo/Kyro-n1-14B
4
+ library_name: transformers
5
+ language:
6
+ - en
7
+ - zh
8
+ - fr
9
+ - es
10
+ - pt
11
+ - de
12
+ - it
13
+ - ru
14
+ - ja
15
+ - ko
16
+ - vi
17
+ - th
18
+ - ar
19
+ - fa
20
+ - he
21
+ - tr
22
+ - cs
23
+ - pl
24
+ - hi
25
+ - bn
26
+ - ur
27
+ - id
28
+ - ms
29
+ - lo
30
+ - my
31
+ - ceb
32
+ - km
33
+ - tl
34
+ - nl
35
+ tags:
36
+ - trl
37
+ - Reasoning
38
+ - open-llm
39
+ - synthetic-data
40
+ - Deepseek-R1
41
+ - Qwen2.5
42
+ - fine-tune
43
+ - unsloth
44
+ - Conversational
45
+ - Agentic
46
+ - mlx
47
+ - mlx-my-repo
48
+ ---
49
+
50
+ # KYUNGYONG/Kyro-n1-14B-4bit
51
+
52
+ The Model [KYUNGYONG/Kyro-n1-14B-4bit](https://huggingface.co/KYUNGYONG/Kyro-n1-14B-4bit) was converted to MLX format from [open-neo/Kyro-n1-14B](https://huggingface.co/open-neo/Kyro-n1-14B) using mlx-lm version **0.21.5**.
53
+
54
+ ## Use with mlx
55
+
56
+ ```bash
57
+ pip install mlx-lm
58
+ ```
59
+
60
+ ```python
61
+ from mlx_lm import load, generate
62
+
63
+ model, tokenizer = load("KYUNGYONG/Kyro-n1-14B-4bit")
64
+
65
+ prompt="hello"
66
+
67
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
68
+ messages = [{"role": "user", "content": prompt}]
69
+ prompt = tokenizer.apply_chat_template(
70
+ messages, tokenize=False, add_generation_prompt=True
71
+ )
72
+
73
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
74
+ ```