Ppoyaa commited on
Commit
97a6866
1 Parent(s): 52bfddd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +47 -2
README.md CHANGED
@@ -5,7 +5,52 @@ tags:
5
  - merge
6
 
7
  ---
8
- # merge
9
 
10
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
11
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  - merge
6
 
7
  ---
8
+ # KeplerRP-7B-128K-0.2
9
 
10
+ This is a merge of pre-trained language models that specializes in roleplaying, created using [mergekit](https://github.com/cg123/mergekit).
11
 
12
+ ***
13
+ ## 💻 Usage
14
+
15
+ ```python
16
+ !pip install -qU transformers accelerate
17
+
18
+ from transformers import AutoTokenizer
19
+ import transformers
20
+ import torch
21
+
22
+ model = "Ppoyaa/KeplerRP-7B-128K-0.2"
23
+ messages = [{"role": "user", "content": "What is a large language model?"}]
24
+
25
+ tokenizer = AutoTokenizer.from_pretrained(model)
26
+ prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
27
+ pipeline = transformers.pipeline(
28
+ "text-generation",
29
+ model=model,
30
+ torch_dtype=torch.float16,
31
+ device_map="auto",
32
+ )
33
+
34
+ outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
35
+ print(outputs[0]["generated_text"])
36
+ ```
37
+ ***
38
+ Merge Details Below:
39
+
40
+ <details><summary>See Merge Config</summary>
41
+
42
+ ```
43
+ ChaoticNeutrals/BuRP_7B
44
+ Endevor/InfinityRP-v1-7B
45
+ Nitral-AI/Kunocchini-7b-128k-test
46
+ core-3/kuno-royale-v2-7b
47
+ KatyTheCutie/LemonadeRP-4.5.3
48
+ grimjim/kukulemon-7B
49
+ MaziyarPanahi/Calme-7B-Instruct-v0.9
50
+ icefog72/WestIceLemonTeaRP-32k-7b
51
+ crestf411/daybreak-kunoichi-2dpo-7b
52
+ Undi95/Mistral-RP-0.1-7B
53
+ mlabonne/AlphaMonarch-7B
54
+ ChaoticNeutrals/Nyanade_Stunna-Maid-7B-v0.2
55
+ ```
56
+ </details><br>