Update README.md

README.md

@@ -44,4 +44,32 @@ This project is led by qnguyen3 and teknium.
 ## Usage
 ### Prompt Format
 - Like other LLaVA's variants, this model uses Vicuna-V1 as its prompt template. Please refer to `conv_llava_v1` in (this file)[https://github.com/qnguyen3/hermes-llava/blob/main/llava/conversation.py]
-- For Gradio UI, please visit this (GitHub Repo)[https://github.com/qnguyen3/hermes-llava]
+- For Gradio UI, please visit this (GitHub Repo)[https://github.com/qnguyen3/hermes-llava]
+
+### Function Calling
+- For functiong calling, the message should start with a `<fn_call>` tag. Here is an example:
+
+```json
+<fn_call>{
+  "type": "object",
+  "properties": {
+    "bus_colors": {
+      "type": "array",
+      "description": "The colors of the bus in the image.",
+      "items": {
+        "type": "string",
+        "enum": ["red", "blue", "green", "white"]
+      }
+    },
+    "bus_features": {
+      "type": "string",
+      "description": "The features seen on the back of the bus."
+    },
+    "bus_location": {
+      "type": "string",
+      "description": "The location of the bus (driving or pulled off to the side).",
+      "enum": ["driving", "pulled off to the side"]
+    }
+  }
+}
+```