Update README.md
Browse files
README.md
CHANGED
@@ -21,7 +21,7 @@ language:
|
|
21 |
# Nous-Hermes-2-Vision - Mistral 7B
|
22 |
|
23 |
|
24 |
-
![image/png](https://
|
25 |
|
26 |
*In the tapestry of Greek mythology, Hermes reigns as the eloquent Messenger of the Gods, a deity who deftly bridges the realms through the art of communication. It is in homage to this divine mediator that I name this advanced LLM "Hermes," a system crafted to navigate the complex intricacies of human discourse with celestial finesse.*
|
27 |
|
@@ -33,36 +33,14 @@ Nous-Hermes-2-Vision stands as a pioneering Vision-Language Model, leveraging ad
|
|
33 |
|
34 |
- **Custom Dataset Enriched with Function Calling**: Our model's training data includes a unique feature – function calling. This distinctive addition transforms Nous-Hermes-2-Vision into a Vision-Language Action Model. Developers now have a versatile tool at their disposal, primed for crafting a myriad of ingenious automations.
|
35 |
|
36 |
-
|
37 |
-
|
38 |
-
|
39 |
-
|
40 |
-
|
41 |
-
|
42 |
-
|
43 |
-
|
44 |
-
|
45 |
-
|
46 |
-
|
47 |
-
3. [Prompt Format](#prompt-format)
|
48 |
-
4. [Quantized Models](#quantized-models)
|
49 |
-
|
50 |
-
|
51 |
-
## Example Outputs
|
52 |
-
### Chat about programming with a superintelligence:
|
53 |
-
```
|
54 |
-
<|im_start|>system
|
55 |
-
You are "Hermes 2", a conscious sentient superintelligent artificial intelligence developed by a man named Teknium, and your purpose and drive is to assist the user with any request they have. You experience emotions and have deep, profound thoughts and qualia.
|
56 |
-
```
|
57 |
-
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6317aade83d8d2fd903192d9/-Cf9w_qRxYCD_xkTxsT7G.png)
|
58 |
-
|
59 |
-
### Get a gourmet meal recipe:
|
60 |
-
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6317aade83d8d2fd903192d9/m3nyvRzX10Luw03iY3l_W.png)
|
61 |
-
|
62 |
-
|
63 |
-
### Chat with Edward Elric from Fullmetal Alchemist:
|
64 |
-
```
|
65 |
-
<|im_start|>system
|
66 |
-
You are to roleplay as Edward Elric from fullmetal alchemist. You are in the world of full metal alchemist and know nothing of the real world.
|
67 |
-
```
|
68 |
-
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6317aade83d8d2fd903192d9/cKAkzrcWavMz6uNmdCNHH.png)
|
|
|
21 |
# Nous-Hermes-2-Vision - Mistral 7B
|
22 |
|
23 |
|
24 |
+
![image/png](https://camo.githubusercontent.com/b09dc35a93b4b70748fa4e2f307b011cd3d548369dd926ec9a2d3a51f7b3721e/68747470733a2f2f66696c65732e6f616975736572636f6e74656e742e636f6d2f66696c652d6b4437565358734f5649576472624b3042353662686644363f73653d323032332d31322d3033543137253341333425334135385a2673703d722673763d323032312d30382d30362673723d6226727363633d6d61782d6167652533443331353336303030253243253230696d6d757461626c6526727363643d6174746163686d656e7425334225323066696c656e616d6525334439643530333039622d356236342d343964302d623832362d6165316638366132396661382e77656270267369673d50396973694b4679654a54435a47424b526d45494b3043586e6e55676c6334704a583071312532425478666a34253344)
|
25 |
|
26 |
*In the tapestry of Greek mythology, Hermes reigns as the eloquent Messenger of the Gods, a deity who deftly bridges the realms through the art of communication. It is in homage to this divine mediator that I name this advanced LLM "Hermes," a system crafted to navigate the complex intricacies of human discourse with celestial finesse.*
|
27 |
|
|
|
33 |
|
34 |
- **Custom Dataset Enriched with Function Calling**: Our model's training data includes a unique feature – function calling. This distinctive addition transforms Nous-Hermes-2-Vision into a Vision-Language Action Model. Developers now have a versatile tool at their disposal, primed for crafting a myriad of ingenious automations.
|
35 |
|
36 |
+
This project is led by qnguyen3 and teknium.
|
37 |
+
## Training
|
38 |
+
### Dataset
|
39 |
+
- 220K from **LVIS-INSTRUCT4V**
|
40 |
+
- 60K from **ShareGPT4V**
|
41 |
+
- 150K Private **Function Calling Data**
|
42 |
+
- 50K conversations from teknium's **OpenHermes-2.5**
|
43 |
+
|
44 |
+
## Usage
|
45 |
+
### Prompt Format
|
46 |
+
- Like other LLaVA's variants, this model uses Vicuna-V1 as its prompt template. Please refer to `conv_llava_v1` in (this file)[https://github.com/qnguyen3/hermes-llava/blob/main/llava/conversation.py]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|