Text Generation
Transformers
Safetensors
llama
generated_from_trainer
axolotl
conversational
Inference Endpoints
text-generation-inference

How to access function calling capabilities?

#15
by pyraminded - opened

Thank you for this work!

Model card says dolphin has function calling capabilities. I'm looking for information on how I would provide my functions, their purpose, parameters etc. for the model so that it can prompt me to use them when appropriate.

How to call function call? Is there any example?

does this model uses the openchatml to access to the function call/tools? how to access to this capabilities using ollama?

they trained it on Locutusque/function-calling-chatml
try sth like this:

<|im_start|>system
You are a helpful assistant with access to the following functions. Use them if required -
    {
    "name": "get_exchange_rate",
    "description": "Get the exchange rate between two currencies",
    "parameters": {
        "type": "object",
        "properties": {
            "base_currency": {
                "type": "string",
                "description": "The currency to convert from"
            },
            "target_currency": {
                "type": "string",
                "description": "The currency to convert to"
            }
        },
        "required": [
            "base_currency",
            "target_currency"
        ]
    }
}<|im_end|>
<|im_start|>user
Can you book a flight for me from New York to London?<|im_end|>
<|im_start|>assistant

Sign up or log in to comment