Update README.md
Browse files
README.md
CHANGED
@@ -44,4 +44,32 @@ This project is led by qnguyen3 and teknium.
|
|
44 |
## Usage
|
45 |
### Prompt Format
|
46 |
- Like other LLaVA's variants, this model uses Vicuna-V1 as its prompt template. Please refer to `conv_llava_v1` in (this file)[https://github.com/qnguyen3/hermes-llava/blob/main/llava/conversation.py]
|
47 |
-
- For Gradio UI, please visit this (GitHub Repo)[https://github.com/qnguyen3/hermes-llava]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
44 |
## Usage
|
45 |
### Prompt Format
|
46 |
- Like other LLaVA's variants, this model uses Vicuna-V1 as its prompt template. Please refer to `conv_llava_v1` in (this file)[https://github.com/qnguyen3/hermes-llava/blob/main/llava/conversation.py]
|
47 |
+
- For Gradio UI, please visit this (GitHub Repo)[https://github.com/qnguyen3/hermes-llava]
|
48 |
+
|
49 |
+
### Function Calling
|
50 |
+
- For functiong calling, the message should start with a `<fn_call>` tag. Here is an example:
|
51 |
+
|
52 |
+
```json
|
53 |
+
<fn_call>{
|
54 |
+
"type": "object",
|
55 |
+
"properties": {
|
56 |
+
"bus_colors": {
|
57 |
+
"type": "array",
|
58 |
+
"description": "The colors of the bus in the image.",
|
59 |
+
"items": {
|
60 |
+
"type": "string",
|
61 |
+
"enum": ["red", "blue", "green", "white"]
|
62 |
+
}
|
63 |
+
},
|
64 |
+
"bus_features": {
|
65 |
+
"type": "string",
|
66 |
+
"description": "The features seen on the back of the bus."
|
67 |
+
},
|
68 |
+
"bus_location": {
|
69 |
+
"type": "string",
|
70 |
+
"description": "The location of the bus (driving or pulled off to the side).",
|
71 |
+
"enum": ["driving", "pulled off to the side"]
|
72 |
+
}
|
73 |
+
}
|
74 |
+
}
|
75 |
+
```
|