MaziyarPanahi commited on
Commit
f40c14a
1 Parent(s): bd61800

Adding the missing mergekit config (#5)

Browse files

- Adding the missing mergekit config (d788b5b542cb3be28e14635af3155c3d50bd65f5)

Bioxtral-4x7B-v0.1_mergekit_moe_config.yaml ADDED
@@ -0,0 +1,43 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ base_model: cognitivecomputations/WestLake-7B-v2-laser
2
+ gate_mode: hidden
3
+ dtype: bfloat16
4
+ experts:
5
+ - source_model: mlabonne/Daredevil-7B
6
+ positive_prompts:
7
+ - "Answer this question from the ARC (Argument Reasoning Comprehension)."
8
+ - "Use common sense and logical reasoning skills."
9
+ negative_prompts:
10
+ - "nonsense"
11
+ - "irrational"
12
+ - "math"
13
+ - "code"
14
+ - source_model: cognitivecomputations/WestLake-7B-v2-laser
15
+ positive_prompts:
16
+ - "Answer this question from the Winogrande test."
17
+ - "Use advanced knowledge of culture and humanity"
18
+ negative_prompts:
19
+ - "ignorance"
20
+ - "uninformed"
21
+ - "creativity"
22
+ - source_model: mlabonne/Daredevil-7B
23
+ positive_prompts:
24
+ - "Calculate the answer to this math problem"
25
+ - "My mathematical capabilities are strong, allowing me to handle complex mathematical queries"
26
+ - "solve for"
27
+ negative_prompts:
28
+ - "incorrect"
29
+ - "inaccurate"
30
+ - "creativity"
31
+ - source_model: BioMistral/BioMistral-7B
32
+ positive_prompts:
33
+ - "Provide a detailed explanation based on medical literature."
34
+ - "Apply clinical reasoning to answer this healthcare question."
35
+ - "Use biomedical knowledge to solve this problem."
36
+ - "Interpret these clinical findings in the context of patient care."
37
+ - "Leverage your understanding of healthcare systems to advise on policy."
38
+ negative_prompts:
39
+ - "vague"
40
+ - "non-scientific"
41
+ - "unrelated to healthcare"
42
+ - "simplistic understanding"
43
+ - "ignore clinical guidelines"