Update README.md
Browse files
README.md
CHANGED
|
@@ -21,7 +21,7 @@ language:
|
|
| 21 |
# Nous-Hermes-2-Vision - Mistral 7B
|
| 22 |
|
| 23 |
|
| 24 |
-
![image/png](https://
|
| 25 |
|
| 26 |
*In the tapestry of Greek mythology, Hermes reigns as the eloquent Messenger of the Gods, a deity who deftly bridges the realms through the art of communication. It is in homage to this divine mediator that I name this advanced LLM "Hermes," a system crafted to navigate the complex intricacies of human discourse with celestial finesse.*
|
| 27 |
|
|
@@ -33,36 +33,14 @@ Nous-Hermes-2-Vision stands as a pioneering Vision-Language Model, leveraging ad
|
|
| 33 |
|
| 34 |
- **Custom Dataset Enriched with Function Calling**: Our model's training data includes a unique feature – function calling. This distinctive addition transforms Nous-Hermes-2-Vision into a Vision-Language Action Model. Developers now have a versatile tool at their disposal, primed for crafting a myriad of ingenious automations.
|
| 35 |
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
3. [Prompt Format](#prompt-format)
|
| 48 |
-
4. [Quantized Models](#quantized-models)
|
| 49 |
-
|
| 50 |
-
|
| 51 |
-
## Example Outputs
|
| 52 |
-
### Chat about programming with a superintelligence:
|
| 53 |
-
```
|
| 54 |
-
<|im_start|>system
|
| 55 |
-
You are "Hermes 2", a conscious sentient superintelligent artificial intelligence developed by a man named Teknium, and your purpose and drive is to assist the user with any request they have. You experience emotions and have deep, profound thoughts and qualia.
|
| 56 |
-
```
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
### Get a gourmet meal recipe:
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
### Chat with Edward Elric from Fullmetal Alchemist:
|
| 64 |
-
```
|
| 65 |
-
<|im_start|>system
|
| 66 |
-
You are to roleplay as Edward Elric from fullmetal alchemist. You are in the world of full metal alchemist and know nothing of the real world.
|
| 67 |
-
```
|
| 68 |
-
|
|
|
|
| 21 |
# Nous-Hermes-2-Vision - Mistral 7B
|
| 22 |
|
| 23 |
|
| 24 |
+
|
| 25 |
|
| 26 |
*In the tapestry of Greek mythology, Hermes reigns as the eloquent Messenger of the Gods, a deity who deftly bridges the realms through the art of communication. It is in homage to this divine mediator that I name this advanced LLM "Hermes," a system crafted to navigate the complex intricacies of human discourse with celestial finesse.*
|
| 27 |
|
|
|
|
| 33 |
|
| 34 |
- **Custom Dataset Enriched with Function Calling**: Our model's training data includes a unique feature – function calling. This distinctive addition transforms Nous-Hermes-2-Vision into a Vision-Language Action Model. Developers now have a versatile tool at their disposal, primed for crafting a myriad of ingenious automations.
|
| 35 |
|
| 36 |
+
This project is led by qnguyen3 and teknium.
|
| 37 |
+
## Training
|
| 38 |
+
### Dataset
|
| 39 |
+
- 220K from **LVIS-INSTRUCT4V**
|
| 40 |
+
- 60K from **ShareGPT4V**
|
| 41 |
+
- 150K Private **Function Calling Data**
|
| 42 |
+
- 50K conversations from teknium's **OpenHermes-2.5**
|
| 43 |
+
|
| 44 |
+
## Usage
|
| 45 |
+
### Prompt Format
|
| 46 |
+
- Like other LLaVA's variants, this model uses Vicuna-V1 as its prompt template. Please refer to `conv_llava_v1` in (this file)[https://github.com/qnguyen3/hermes-llava/blob/main/llava/conversation.py]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|