AABAAB commited on
Commit
14b9d91
1 Parent(s): c858364

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -1
README.md CHANGED
@@ -2,4 +2,38 @@
2
  license: apache-2.0
3
  ---
4
 
5
- Quantization of [mzbac/llama-3-8B-Instruct-function-calling-v0.2](https://huggingface.co/mzbac/llama-3-8B-Instruct-function-calling-v0.2) info GGUF
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: apache-2.0
3
  ---
4
 
5
+ Quantization of [mzbac/llama-3-8B-Instruct-function-calling-v0.2](https://huggingface.co/mzbac/llama-3-8B-Instruct-function-calling-v0.2) info GGUF
6
+
7
+ # Llama 3 function calling
8
+
9
+ Tested within LM Studio.
10
+
11
+
12
+ ## Request
13
+ ```bash
14
+ curl --location 'http://localhost:5000/v1/chat/completions' \
15
+ --header 'Content-Type: application/json' \
16
+ --data '{
17
+ "model": "AABAAB/llama-3-8B-Instruct-function-calling-v0.2/llama-3-8B-Instruct-function-calling-v0.2_Q8_0.gguf",
18
+ "messages": [
19
+ {
20
+ "role": "system",
21
+ "content": "You are a helpful assistant with access to the following functions. Use them if required - {\"name\": \"search_web\",\"description\": \"Perform a web search for a given search terms.\",\"parameter\": {\"type\": \"object\", \"properties\": {\"search_terms\": {\"type\": \"array\",\"items\": {\"type\": \"string\"},\"description\": \"The search queries for which the search is performed.\",\"required\": True,}}},}"
22
+ },
23
+ {
24
+ "role": "user",
25
+ "content": "What is the weather in Sydney?"
26
+ }
27
+ ],
28
+ "stream": false
29
+ }'
30
+ ```
31
+
32
+ ## Response
33
+
34
+ ```
35
+ <functioncall> {\"name\": \"search_web\", \"arguments\": {\"search_terms\": [\"weather in Sydney\"]}}
36
+ ```
37
+
38
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/663695e864f6d7cc4446c53b/P5_a-YtkEvJOz1cHCjNa_.png)
39
+