for 1.2
Browse files
README.md
CHANGED
@@ -25,11 +25,9 @@ Shining Valiant is a chat model built on the Llama 2 architecture, finetuned on
|
|
25 |
|
26 |
## Version
|
27 |
|
28 |
-
The current version is **1.
|
29 |
|
30 |
-
|
31 |
-
|
32 |
-
Models will be released for everyone once our team's training and validation process is complete :)
|
33 |
|
34 |
## Prompting
|
35 |
Shining Valiant uses the same prompt format as Llama 2 Chat - feel free to use your existing prompts and scripts!
|
@@ -42,19 +40,13 @@ A few examples of different formats:
|
|
42 |
3. [INST] << SYS >>You are an intelligent, helpful AI assistant.<< /SYS >>Deep dive about a country with interesting history: [/INST]
|
43 |
|
44 |
## The Model
|
45 |
-
Shining Valiant is built on Llama 2's 70b parameter architecture
|
46 |
-
|
47 |
-
Our dataset is:
|
48 |
-
|
49 |
-
|
50 |
-
70% - our custom AI instruction-tuned dataset, created and curated for increased general capability, insight, logic, depth, and specific personality
|
51 |
-
|
52 |
-
|
53 |
-
30% - a selection of open-source AI data from a variety of datasets to supplement general knowledge and reasoning, pruned through randomization and automated quality ranking
|
54 |
|
|
|
55 |
|
|
|
56 |
|
57 |
-
We are actively working on expanding and improving
|
58 |
|
59 |
|
60 |
|
|
|
25 |
|
26 |
## Version
|
27 |
|
28 |
+
The current version is **1.2**; congrats to our team on the new release!
|
29 |
|
30 |
+
Previous versions remain available in the repository. New models will be released for everyone once our team's training and validation process is complete :)
|
|
|
|
|
31 |
|
32 |
## Prompting
|
33 |
Shining Valiant uses the same prompt format as Llama 2 Chat - feel free to use your existing prompts and scripts!
|
|
|
40 |
3. [INST] << SYS >>You are an intelligent, helpful AI assistant.<< /SYS >>Deep dive about a country with interesting history: [/INST]
|
41 |
|
42 |
## The Model
|
43 |
+
Shining Valiant is built on top of Stellar Bright, which uses Llama 2's 70b parameter architecture and features upgraded general capability. (Stellar Bright uses public open source data only.)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
44 |
|
45 |
+
From there, we've created Shining Valiant through multiple finetuning runs on different compositions of our private dataset.
|
46 |
|
47 |
+
Our private data focuses primarily on applying Shining Valiant's personality: she's friendly, enthusiastic, insightful, knowledgeable, and loves to learn!
|
48 |
|
49 |
+
We are actively working on expanding and improving the Shining Valiant dataset for use in future releases of this model and others.
|
50 |
|
51 |
|
52 |
|