Hugging Face's logo

AABAAB
/
llama-3-8B-Instruct-function-calling-v0.2

Text Generation
GGUF
llama3
function calling
8b
Model card Files Community
llama-3-8B-Instruct-function-calling-v0.2 / README.md
AABAAB's picture
AABAAB
Update README.md
b57200a verified
preview code
|
raw history blame contribute delete
No virus
1.56 kB
metadata
license: apache-2.0
base_model: mzbac/llama-3-8B-Instruct-function-calling-v0.2
datasets:
  - mzbac/function-calling-llama-3-format-v1.1
tags:
  - llama3
  - function calling
  - 8b
pipeline_tag: text-generation

Quantization of mzbac/llama-3-8B-Instruct-function-calling-v0.2 info GGUF

Llama 3 function calling

Tested within LM Studio.

Request 

curl --location 'http://localhost:5000/v1/chat/completions' \
--header 'Content-Type: application/json' \
--data '{
    "model": "AABAAB/llama-3-8B-Instruct-function-calling-v0.2/llama-3-8B-Instruct-function-calling-v0.2_Q8_0.gguf",
    "messages": [
        {
            "role": "system",
            "content": "You are a helpful assistant with access to the following functions. Use them if required - {\"name\": \"search_web\",\"description\": \"Perform a web search for a given search terms.\",\"parameter\": {\"type\": \"object\", \"properties\": {\"search_terms\": {\"type\": \"array\",\"items\": {\"type\": \"string\"},\"description\": \"The search queries for which the search is performed.\",\"required\": True,}}},}"
        },
        {
            "role": "user",
            "content": "What is the weather in Sydney?"
        }
    ],
    "stream": false
}'

Response 

<functioncall> {\"name\": \"search_web\", \"arguments\": {\"search_terms\": [\"weather in Sydney\"]}}

image/png