heyuan commited on
Commit
490aa67
1 Parent(s): 405a169

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -54
README.md CHANGED
@@ -10,57 +10,4 @@ base_model:
10
  - NeverSleep/Noromaid-7b-v0.2
11
  ---
12
 
13
- **Deprecated**: please check-out [uproai/Rose-2x7B](https://huggingface.co/uproai/Rose-2x7B) or [uproai/Rose-2x7B-GGUF](https://huggingface.co/uproai/Rose-2x7B-GGUF)
14
-
15
-
16
- # [Deprecated] RosMistral-2x7B
17
-
18
- RosMistral-2x7B is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
19
- * [uproai/RosMistral-2x7B](https://huggingface.co/uproai/RosMistral-2x7B)
20
- * [NeverSleep/Noromaid-7b-v0.2](https://huggingface.co/NeverSleep/Noromaid-7b-v0.2)
21
-
22
- ## 🧩 Configuration
23
-
24
- ```yamlslices:
25
- - sources:
26
- - model: uproai/RosMistral-2x7B
27
- layer_range: [0, 32]
28
- - model: NeverSleep/Noromaid-7b-v0.2
29
- layer_range: [0, 32]
30
- # - model: saishf/West-Hermes-7B
31
- # layer_range: [0, 32]
32
- merge_method: slerp
33
- base_model: uproai/RosMistral-2x7B
34
- parameters:
35
- t:
36
- - filter: self_attn
37
- value: [0, 0.5, 0.3, 0.7, 1]
38
- - filter: mlp
39
- value: [1, 0.5, 0.7, 0.3, 0]
40
- - value: 0.5
41
- dtype: bfloat16```
42
-
43
- ## 💻 Usage
44
-
45
- ```python
46
- !pip install -qU transformers accelerate
47
-
48
- from transformers import AutoTokenizer
49
- import transformers
50
- import torch
51
-
52
- model = "uproai/RosMistral-2x7B"
53
- messages = [{"role": "user", "content": "What is a large language model?"}]
54
-
55
- tokenizer = AutoTokenizer.from_pretrained(model)
56
- prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
57
- pipeline = transformers.pipeline(
58
- "text-generation",
59
- model=model,
60
- torch_dtype=torch.float16,
61
- device_map="auto",
62
- )
63
-
64
- outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
65
- print(outputs[0]["generated_text"])
66
- ```
 
10
  - NeverSleep/Noromaid-7b-v0.2
11
  ---
12
 
13
+ **Deprecated**: please check out [uproai/Rose-2x7B](https://huggingface.co/uproai/Rose-2x7B) or [uproai/Rose-2x7B-GGUF](https://huggingface.co/uproai/Rose-2x7B-GGUF)