|
--- |
|
language: |
|
- en |
|
pipeline_tag: text-generation |
|
tags: |
|
- shining-valiant |
|
- valiant |
|
- valiant-labs |
|
- llama |
|
- llama-2 |
|
- llama-2-chat |
|
- 70b |
|
model_type: llama |
|
license: llama2 |
|
--- |
|
|
|
|
|
 |
|
|
|
|
|
Shining Valiant is a chat model built on the Llama 2 architecture, finetuned on our data for insight, creativity, passion, and friendliness. |
|
- Uses the llama-2-70b-chat model, with safetensors |
|
- Finetuned on multiple runs across private and public data |
|
- Data focused on knowledge, enthusiasm, and structured reasoning |
|
|
|
## Version |
|
|
|
The current version is **1.3!** |
|
|
|
Version 1.4 is preparing for release! We've expanded our personality dataset and fixed some bugs to deliver our strongest real-chat experience so far. |
|
|
|
(We're also exploring new models and architectures!) |
|
|
|
Previous versions remain available in the repository. New models will be released for everyone once our team's training and validation process is complete. |
|
|
|
## Evaluation |
|
|
|
| Model | Avg | ARC | HS | MMLU | TQA | WG | GSM | |
|
|-----------------------|--------|-------|-------|--------|-------|-------|-------| |
|
| **Shining Valiant 1.3** | 73.78 | 71.33 | 90.96 | 71.21 | 70.29 | 84.21 | 54.66 | |
|
|
|
## Prompting Guide |
|
Shining Valiant uses the same prompt format as Llama 2 Chat - feel free to use your existing prompts and scripts! |
|
A few examples of different formats: |
|
|
|
1. [INST] Good morning! Can you let me know how to parse a text file and turn the semicolons into commas? [/INST] |
|
|
|
2. [INST] (You are an intelligent, helpful AI assistant.) Hello, can you write me a thank you letter? [/INST] |
|
|
|
3. [INST] << SYS >>You are an intelligent, helpful AI assistant.<< /SYS >>Deep dive about a country with interesting history: [/INST] |
|
|
|
## The Model |
|
Shining Valiant is built on top of Sunset Boulevard, which uses Llama 2's 70b parameter architecture and features upgraded general capability. |
|
|
|
From there, we've created Shining Valiant through multiple finetuning runs on different compositions of our private dataset. |
|
|
|
Our private data focuses primarily on applying Shining Valiant's personality: she's friendly, enthusiastic, insightful, knowledgeable, and loves to learn! |
|
|
|
We are actively working on expanding and improving the Shining Valiant dataset for use in future releases of this model and others. |
|
|
|
|
|
|
|
 |
|
|
|
|
|
Shining Valiant is created by [Valiant Labs.](http://valiantlabs.ca/) |
|
|
|
[Follow us on X for updates on our models!](https://twitter.com/valiant_labs) |
|
|
|
We care about open source. |
|
For everyone to use. |
|
|
|
We encourage others to finetune further from our models. |
