Triangle104 commited on
Commit
18514de
1 Parent(s): c60562d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +147 -0
README.md CHANGED
@@ -17,6 +17,153 @@ library_name: transformers
17
  This model was converted to GGUF format from [`oxyapi/oxy-1-micro`](https://huggingface.co/oxyapi/oxy-1-micro) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
18
  Refer to the [original model card](https://huggingface.co/oxyapi/oxy-1-micro) for more details on the model.
19
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  ## Use with llama.cpp
21
  Install llama.cpp through brew (works on Mac and Linux)
22
 
 
17
  This model was converted to GGUF format from [`oxyapi/oxy-1-micro`](https://huggingface.co/oxyapi/oxy-1-micro) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
18
  Refer to the [original model card](https://huggingface.co/oxyapi/oxy-1-micro) for more details on the model.
19
 
20
+ ---
21
+ Model details:
22
+ -
23
+ Oxy 1 Micro is a fine-tuned version of the Qwen2-1.5B language model, specialized for role-play
24
+ scenarios. Despite its small size, it delivers impressive performance
25
+ in generating engaging dialogues and interactive storytelling.
26
+
27
+
28
+ Developed by Oxygen (oxyapi), with contributions from TornadoSoftwares, Oxy 1 Micro aims to provide an accessible and efficient language model for creative and immersive role-play experiences.
29
+
30
+
31
+
32
+
33
+
34
+
35
+
36
+ Model Details
37
+
38
+
39
+
40
+
41
+ Model Name: Oxy 1 Micro
42
+ Model ID: oxyapi/oxy-1-micro
43
+ Base Model: Qwen/Qwen2-1.5B
44
+ Model Type: Chat Completions
45
+ License: Apache-2.0
46
+ Language: English
47
+ Tokenizer: Qwen/Qwen2.5-1.5B-Instruct
48
+ Max Input Tokens: 32,768
49
+ Max Output Tokens: 8,192
50
+
51
+
52
+
53
+
54
+
55
+
56
+
57
+ Features
58
+
59
+
60
+
61
+
62
+ Fine-tuned for Role-Play: Specially trained to generate dynamic and contextually rich role-play dialogues.
63
+ Efficient: Compact model size allows for faster inference and reduced computational resources.
64
+ Parameter Support:
65
+ temperature
66
+ top_p
67
+ top_k
68
+ frequency_penalty
69
+ presence_penalty
70
+ max_tokens
71
+
72
+
73
+
74
+
75
+
76
+
77
+
78
+
79
+
80
+ Metadata
81
+
82
+
83
+
84
+
85
+ Owned by: Oxygen (oxyapi)
86
+ Contributors: TornadoSoftwares
87
+ Description: A Qwen2-1.5B fine-tune for role-play; small model but still good.
88
+
89
+
90
+
91
+
92
+
93
+
94
+
95
+ Usage
96
+
97
+
98
+
99
+
100
+ To utilize Oxy 1 Micro for text generation in role-play scenarios,
101
+ you can load the model using the Hugging Face Transformers library:
102
+
103
+
104
+ from transformers import AutoModelForCausalLM, AutoTokenizer
105
+
106
+ tokenizer = AutoTokenizer.from_pretrained("oxyapi/oxy-1-micro")
107
+ model = AutoModelForCausalLM.from_pretrained("oxyapi/oxy-1-micro")
108
+
109
+ prompt = "You are a wise old wizard in a mystical land. A traveler approaches you seeking advice."
110
+ inputs = tokenizer(prompt, return_tensors="pt")
111
+ outputs = model.generate(**inputs, max_length=500)
112
+ response = tokenizer.decode(outputs[0], skip_special_tokens=True)
113
+ print(response)
114
+
115
+
116
+
117
+
118
+
119
+
120
+
121
+
122
+ Performance
123
+
124
+
125
+
126
+
127
+ Performance benchmarks for Oxy 1 Micro are not available at this
128
+ time. Future updates may include detailed evaluations on relevant
129
+ datasets.
130
+
131
+
132
+
133
+
134
+
135
+
136
+
137
+
138
+ License
139
+
140
+
141
+
142
+
143
+ This model is licensed under the Apache 2.0 License.
144
+
145
+
146
+
147
+
148
+
149
+
150
+
151
+ Citation
152
+
153
+
154
+
155
+
156
+ If you find Oxy 1 Micro useful in your research or applications, please cite it as:
157
+
158
+
159
+ @misc{oxy1micro2024,
160
+ title={Oxy 1 Micro: A Fine-Tuned Qwen2-1.5B Model for Role-Play},
161
+ author={Oxygen (oxyapi)},
162
+ year={2024},
163
+ howpublished={\url{https://huggingface.co/oxyapi/oxy-1-micro}},
164
+ }
165
+
166
+ ---
167
  ## Use with llama.cpp
168
  Install llama.cpp through brew (works on Mac and Linux)
169