sequelbox commited on
Commit
4071ec2
1 Parent(s): 5ffec7b
Files changed (1) hide show
  1. README.md +50 -0
README.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ inference: false
3
+ language:
4
+ - en
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - shining-valiant
8
+ - valiant
9
+ - valiant-labs
10
+ - llama
11
+ - llama-2
12
+ model_type: llama
13
+ license: llama2
14
+ ---
15
+
16
+ <!-- header start -->
17
+ <!-- header end -->
18
+
19
+ # Shining Valiant
20
+
21
+ Shining Valiant is a chat model built on the Llama 2 architecture, finetuned on our data for insight, creativity, passion, and friendship.
22
+
23
+ (70b parameters, safetensors format)
24
+
25
+ ## Prompting:
26
+ Shining Valiant uses the same prompt format as Llama 2 Chat - feel free to use your existing prompts and scripts!
27
+ A few examples of different formats:
28
+
29
+ 1. [INST] Good morning! Can you let me know how to parse a text file and turn the semicolons into commas? [/INST]
30
+
31
+ 2. [INST] (You are an intelligent, helpful AI assistant.) Hello, can you write me a thank you letter? [/INST]
32
+
33
+ 3. [INST] Good morning! Can you let me know how to parse a text file and turn the semicolons into commas? [/INST]
34
+
35
+ ## The Model
36
+ Shining Valiant is built on Llama 2's 70b parameter architecture. We've created the model through multiple finetuning runs on different compositions of our dataset.
37
+
38
+ Our dataset is:
39
+ 75% - our custom AI instruction-tuned dataset, created and curated for increased general capability, insight, logic, depth, and specific personality
40
+ 25% - a selection of open-source AI data from a variety of datasets to supplement general knowledge and reasoning
41
+
42
+ We are actively working on expanding and improving this dataset for use in future releases of this model and others.
43
+
44
+ ## Who We Are
45
+ Shining Valiant is created by Valiant Labs.
46
+ We care about open source.
47
+ We make software thinking open source.
48
+ For everyone to use.
49
+
50
+ We encourage others to finetune further from our models.