CookieMaster commited on
Commit
1c4917b
1 Parent(s): 95e2031

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -56
README.md CHANGED
@@ -1,56 +1 @@
1
- ---
2
- tags:
3
- - merge
4
- - mergekit
5
- - lazymergekit
6
- - deepseek-ai/deepseek-coder-6.7b-instruct
7
- base_model:
8
- - deepseek-ai/deepseek-coder-6.7b-instruct
9
- ---
10
-
11
- # deepseek-Kunoichi-DPO
12
-
13
- deepseek-Kunoichi-DPO is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
14
- * [deepseek-ai/deepseek-coder-6.7b-instruct](https://huggingface.co/deepseek-ai/deepseek-coder-6.7b-instruct)
15
-
16
- ## 🧩 Configuration
17
-
18
- ```yaml
19
- models:
20
- - model: SanjiWatsuki/Kunoichi-DPO-v2-7B
21
- # No parameters necessary for base model
22
- - model: deepseek-ai/deepseek-coder-6.7b-instruct
23
- parameters:
24
- density: 0.53
25
- weight: 1.0
26
- merge_method: dare_ties
27
- base_model: SanjiWatsuki/Kunoichi-DPO-v2-7B
28
- parameters:
29
- int8_mask: true
30
- dtype: bfloat16
31
- ```
32
-
33
- ## 💻 Usage
34
-
35
- ```python
36
- !pip install -qU transformers accelerate
37
-
38
- from transformers import AutoTokenizer
39
- import transformers
40
- import torch
41
-
42
- model = "CookieMaster/deepseek-Kunoichi-DPO"
43
- messages = [{"role": "user", "content": "What is a large language model?"}]
44
-
45
- tokenizer = AutoTokenizer.from_pretrained(model)
46
- prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
47
- pipeline = transformers.pipeline(
48
- "text-generation",
49
- model=model,
50
- torch_dtype=torch.float16,
51
- device_map="auto",
52
- )
53
-
54
- outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
55
- print(outputs[0]["generated_text"])
56
- ```
 
1
+ THIS IS NOT FOR USE, THIS IS A TEST BY A STUPID KID