Frowning commited on
Commit
c0a5955
1 Parent(s): fff4ae2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -30
README.md CHANGED
@@ -1,9 +1,7 @@
1
  ---
2
  base_model:
3
  - bluuwhale/L3-SthenoMaidBlackroot-8B-V1
4
- - bluuwhale/L3-SthenoMaidBlackroot-8B-V1
5
- - bluuwhale/L3-SthenoMaidBlackroot-8B-V1
6
- - bluuwhale/L3-SthenoMaidBlackroot-8B-V1
7
  tags:
8
  - merge
9
  - mergekit
@@ -15,9 +13,7 @@ tags:
15
 
16
  L3-SthenoMaidBlackroot-15B-V1 is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
17
  * [bluuwhale/L3-SthenoMaidBlackroot-8B-V1](https://huggingface.co/bluuwhale/L3-SthenoMaidBlackroot-8B-V1)
18
- * [bluuwhale/L3-SthenoMaidBlackroot-8B-V1](https://huggingface.co/bluuwhale/L3-SthenoMaidBlackroot-8B-V1)
19
- * [bluuwhale/L3-SthenoMaidBlackroot-8B-V1](https://huggingface.co/bluuwhale/L3-SthenoMaidBlackroot-8B-V1)
20
- * [bluuwhale/L3-SthenoMaidBlackroot-8B-V1](https://huggingface.co/bluuwhale/L3-SthenoMaidBlackroot-8B-V1)
21
 
22
  ## 🧩 Configuration
23
 
@@ -53,27 +49,3 @@ slices:
53
  model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
54
  ```
55
 
56
- ## 💻 Usage
57
-
58
- ```python
59
- !pip install -qU transformers accelerate
60
-
61
- from transformers import AutoTokenizer
62
- import transformers
63
- import torch
64
-
65
- model = "Frowning/L3-SthenoMaidBlackroot-15B-V1"
66
- messages = [{"role": "user", "content": "What is a large language model?"}]
67
-
68
- tokenizer = AutoTokenizer.from_pretrained(model)
69
- prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
70
- pipeline = transformers.pipeline(
71
- "text-generation",
72
- model=model,
73
- torch_dtype=torch.float16,
74
- device_map="auto",
75
- )
76
-
77
- outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
78
- print(outputs[0]["generated_text"])
79
- ```
 
1
  ---
2
  base_model:
3
  - bluuwhale/L3-SthenoMaidBlackroot-8B-V1
4
+
 
 
5
  tags:
6
  - merge
7
  - mergekit
 
13
 
14
  L3-SthenoMaidBlackroot-15B-V1 is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
15
  * [bluuwhale/L3-SthenoMaidBlackroot-8B-V1](https://huggingface.co/bluuwhale/L3-SthenoMaidBlackroot-8B-V1)
16
+
 
 
17
 
18
  ## 🧩 Configuration
19
 
 
49
  model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
50
  ```
51