Isotonic commited on
Commit
f9e076b
1 Parent(s): 585464e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -65
README.md CHANGED
@@ -19,70 +19,6 @@ TinyMixtral-4x248M-MoE is a Mixure of Experts (MoE) made with the following mode
19
  * [Locutusque/TinyMistral-248M-v2-Instruct](https://huggingface.co/Locutusque/TinyMistral-248M-v2-Instruct)
20
  * [Locutusque/TinyMistral-248M-v2.5](https://huggingface.co/Locutusque/TinyMistral-248M-v2.5)
21
 
22
- ## 🧩 Configuration
23
-
24
- ```yamlbase_model: Felladrin/TinyMistral-248M-SFT-v4
25
- experts:
26
- - source_model: Felladrin/TinyMistral-248M-SFT-v4
27
- positive_prompts:
28
- - "reasoning"
29
- - "logic"
30
- - "problem-solving"
31
- - "critical thinking"
32
- - "analysis"
33
- - "synthesis"
34
- - "evaluation"
35
- - "decision-making"
36
- - "judgment"
37
- - "insight"
38
-
39
- - source_model: Locutusque/LocutusqueXFelladrin-TinyMistral248M-Instruct
40
- positive_prompts:
41
- - "program"
42
- - "software"
43
- - "develop"
44
- - "build"
45
- - "create"
46
- - "design"
47
- - "implement"
48
- - "debug"
49
- - "test"
50
- - "code"
51
- - "python"
52
- - "programming"
53
- - "algorithm"
54
- - "function"
55
-
56
- - source_model: Locutusque/TinyMistral-248M-v2-Instruct
57
- positive_prompts:
58
- - "storytelling"
59
- - "narrative"
60
- - "fiction"
61
- - "creative writing"
62
- - "plot"
63
- - "characters"
64
- - "dialogue"
65
- - "setting"
66
- - "emotion"
67
- - "imagination"
68
- - "scene"
69
- - "story"
70
- - "character"
71
-
72
- - source_model: Locutusque/TinyMistral-248M-v2.5
73
- positive_prompts:
74
- - "chat"
75
- - "conversation"
76
- - "dialogue"
77
- - "discuss"
78
- - "ask questions"
79
- - "share thoughts"
80
- - "explore ideas"
81
- - "learn new things"
82
- - "personal assistant"
83
- - "friendly helper"
84
- ```
85
-
86
  ## 💻 Usage
87
 
88
  ```python
@@ -98,7 +34,7 @@ tokenizer = AutoTokenizer.from_pretrained(model)
98
  pipeline = transformers.pipeline(
99
  "text-generation",
100
  model=model,
101
- model_kwargs={"torch_dtype": torch.float16, "load_in_4bit": True},
102
  )
103
 
104
  messages = [{"role": "user", "content": "Explain what a Mixture of Experts is in less than 100 words."}]
 
19
  * [Locutusque/TinyMistral-248M-v2-Instruct](https://huggingface.co/Locutusque/TinyMistral-248M-v2-Instruct)
20
  * [Locutusque/TinyMistral-248M-v2.5](https://huggingface.co/Locutusque/TinyMistral-248M-v2.5)
21
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
22
  ## 💻 Usage
23
 
24
  ```python
 
34
  pipeline = transformers.pipeline(
35
  "text-generation",
36
  model=model,
37
+ tokenizer=tokenizer
38
  )
39
 
40
  messages = [{"role": "user", "content": "Explain what a Mixture of Experts is in less than 100 words."}]