venkat-srinivasan-nexusflow commited on
Commit
10add89
1 Parent(s): bd84aa4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -68,7 +68,7 @@ docker run --name athene-v2-agent \
68
  You can now submit any OpenAI-Compatible tool-use requests to the model by hitting the VLLM endpoint. Athene-V2-Agent will be able to issue tool calls that you can execute and return results for.
69
 
70
 
71
- **WARNING**: Athene-V2-Agent uses a *CUSTOM* prompting style that is baked into the custom docker image. For best performance, please ensure to use the docker image above for Athene-V2-Agent. Using HuggingFace tokenizer's chat template will yield suboptimal results for Agent usecases.
72
  ### Examples
73
 
74
  An example Weather agent for this can be found here: [Link](example/vllm_v2_weather_agent.py#L186-L193). This example includes handling Athene for queries that are answerable and not answerable by the current tools.
 
68
  You can now submit any OpenAI-Compatible tool-use requests to the model by hitting the VLLM endpoint. Athene-V2-Agent will be able to issue tool calls that you can execute and return results for.
69
 
70
 
71
+ **WARNING**: Athene-V2-Agent uses a *CUSTOM* prompting style that is baked into the custom docker image, as the executable calls are extracted from the model's generated planning. For best performance, please ensure to use the docker image above for Athene-V2-Agent, including when benchmarking the model. Using HuggingFace tokenizer's chat template will yield suboptimal results for Agent usecases. Please reach out to us on Discord if you run into any issues!
72
  ### Examples
73
 
74
  An example Weather agent for this can be found here: [Link](example/vllm_v2_weather_agent.py#L186-L193). This example includes handling Athene for queries that are answerable and not answerable by the current tools.