TornadoAI commited on
Commit
52d2203
1 Parent(s): 677c419

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +80 -14
README.md CHANGED
@@ -1,23 +1,89 @@
1
  ---
2
- base_model: TornadoAI/newoxy
3
- tags:
4
- - text-generation-inference
5
- - transformers
6
- - unsloth
7
- - qwen2
8
- - trl
9
- - sft
10
  license: apache-2.0
11
  language:
12
  - en
 
 
 
 
 
 
 
 
13
  ---
14
 
15
- # Uploaded model
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
 
17
- - **Developed by:** TornadoAI
18
- - **License:** apache-2.0
19
- - **Finetuned from model :** TornadoAI/newoxy
20
 
21
- This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
22
 
23
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
1
  ---
 
 
 
 
 
 
 
 
2
  license: apache-2.0
3
  language:
4
  - en
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - role-play
8
+ - fine-tuned
9
+ - qwen2.5
10
+ base_model:
11
+ - Qwen/Qwen2.5-14B-Instruct
12
+ library_name: transformers
13
  ---
14
 
15
+ ![Oxy 1 Small](https://cdn-uploads.huggingface.co/production/uploads/63c2d8376e6561b339d998b9/fX1qGkR-1BC1EV_sRkO_9.png)
16
+
17
+ ## Introduction
18
+
19
+ **Oxy 1 Small** is a fine-tuned version of the [Qwen2-1.5B](https://huggingface.co/Qwen/Qwen2-1.5B) language model, specialized for **role-play** scenarios. Despite its small size, it delivers impressive performance in generating engaging dialogues and interactive storytelling.
20
+
21
+ Developed by **Oxygen (oxyapi)**, with contributions from **TornadoSoftwares**, Oxy 1 Small aims to provide an accessible and efficient language model for creative and immersive role-play experiences.
22
+
23
+ ## Model Details
24
+
25
+ - **Model Name**: Oxy 1 Small
26
+ - **Model ID**: [oxyapi/oxy-1-small](https://huggingface.co/oxyapi/oxy-1-small)
27
+ - **Base Model**: [Qwen/Qwen2.5-14B-Instruct](https://huggingface.co/Qwen/Qwen2-1.5B)
28
+ - **Model Type**: Chat Completions
29
+ - **License**: Apache-2.0
30
+ - **Language**: English
31
+ - **Tokenizer**: [Qwen/Qwen2.5-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-14B-Instruct)
32
+ - **Max Input Tokens**: 32,768
33
+ - **Max Output Tokens**: 8,192
34
+
35
+ ### Features
36
+
37
+ - **Fine-tuned for Role-Play**: Specially trained to generate dynamic and contextually rich role-play dialogues.
38
+ - **Efficient**: Compact model size allows for faster inference and reduced computational resources.
39
+ - **Parameter Support**:
40
+ - `temperature`
41
+ - `top_p`
42
+ - `top_k`
43
+ - `frequency_penalty`
44
+ - `presence_penalty`
45
+ - `max_tokens`
46
+
47
+ ### Metadata
48
+
49
+ - **Owned by**: Oxygen (oxyapi)
50
+ - **Contributors**: TornadoSoftwares
51
+ - **Description**: A Qwen/Qwen2.5-14B-Instruct fine-tune for role-play trained on custom datasets
52
+
53
+ ## Usage
54
+
55
+ To utilize Oxy 1 Small for text generation in role-play scenarios, you can load the model using the Hugging Face Transformers library:
56
+
57
+ ```python
58
+ from transformers import AutoModelForCausalLM, AutoTokenizer
59
+
60
+ tokenizer = AutoTokenizer.from_pretrained("oxyapi/oxy-1-small")
61
+ model = AutoModelForCausalLM.from_pretrained("oxyapi/oxy-1-small")
62
+
63
+ prompt = "You are a wise old wizard in a mystical land. A traveler approaches you seeking advice."
64
+ inputs = tokenizer(prompt, return_tensors="pt")
65
+ outputs = model.generate(**inputs, max_length=500)
66
+ response = tokenizer.decode(outputs[0], skip_special_tokens=True)
67
+ print(response)
68
+ ```
69
+
70
+ ## Performance
71
+
72
+ Performance benchmarks for Oxy 1 Small are not available at this time. Future updates may include detailed evaluations on relevant datasets.
73
+
74
+ ## License
75
+
76
+ This model is licensed under the [Apache 2.0 License](https://www.apache.org/licenses/LICENSE-2.0).
77
 
78
+ ## Citation
 
 
79
 
80
+ If you find Oxy 1 Small useful in your research or applications, please cite it as:
81
 
82
+ ```
83
+ @misc{oxy1small2024,
84
+ title={Oxy 1 Small: A Fine-Tuned Qwen2.5-14B-Instruct Model for Role-Play},
85
+ author={Oxygen (oxyapi)},
86
+ year={2024},
87
+ howpublished={\url{https://huggingface.co/oxyapi/oxy-1-small}},
88
+ }
89
+ ```