unclecode commited on
Commit
aba856e
1 Parent(s): 0f99dcb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +51 -14
README.md CHANGED
@@ -1,22 +1,59 @@
1
  ---
2
- language:
3
- - en
4
- license: apache-2.0
5
  tags:
6
- - text-generation-inference
7
- - transformers
8
- - unsloth
9
  - llama
10
- - trl
11
- base_model: unsloth/llama-3-8b-Instruct-bnb-4bit
 
 
 
 
12
  ---
13
 
14
- # Uploaded model
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
 
16
- - **Developed by:** unclecode
17
- - **License:** apache-2.0
18
- - **Finetuned from model :** unsloth/llama-3-8b-Instruct-bnb-4bit
 
 
 
 
19
 
20
- This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
1
  ---
 
 
 
2
  tags:
3
+ - function calling
4
+ - tool use
 
5
  - llama
6
+ - llama3
7
+ - tinyllama
8
+ - instruct-tuned
9
+ - 4-bit quantization
10
+ - ggfu
11
+ license: apache-2.0
12
  ---
13
 
14
+ # Function Calling and Tool Use LLaMA Models
15
+
16
+ This repository contains two main versions of LLaMA models fine-tuned for function calling and tool use capabilities:
17
+
18
+ 1. Fine-tuned version of the `LLama3-8b-instruct` model
19
+ 2. `tinyllama` - a smaller model version
20
+
21
+ For each version, the following variants are available:
22
+
23
+ - 16-bit quantized model
24
+ - 4-bit quantized model
25
+ - GGFU format for use with llama.cpp
26
+
27
+ ## Dataset
28
+
29
+ The models were fine-tuned using a modified version of the `ilacai/glaive-function-calling-v2-sharegpt` dataset, which can be found at [unclecode/glaive-function-calling-llama3](https://huggingface.co/datasets/unclecode/glaive-function-calling-llama3).
30
+
31
+ ## Usage
32
+
33
+ To learn how to use these models, refer to the Colab notebook: [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://tinyurl.com/ucfllm)
34
+
35
+ This is the first version of the models, and work is in progress to further train them with multi-tool detection and native tool binding support.
36
+
37
+ ## Library and Tools Support
38
+
39
+ A library is being developed to manage tools and add tool support for major LLMs, regardless of their built-in capabilities. You can find examples and contribute to the library at the following repository:
40
+
41
+ [https://github.com/unclecode/fllm](https://github.com/unclecode/fllm)
42
+
43
+ Please open an issue in the repository for any bugs or collaboration requests.
44
+
45
+ ## Other Models
46
+
47
+ Here are links to other related models:
48
 
49
+ - [unclecode/llama3-function-call-lora-adapter-240424](https://huggingface.co/unclecode/llama3-function-call-lora-adapter-240424)
50
+ - [unclecode/llama3-function-call-16bit-240424](https://huggingface.co/unclecode/llama3-function-call-16bit-240424)
51
+ - [unclecode/llama3-function-call-4bit-240424](https://huggingface.co/unclecode/llama3-function-call-4bit-240424)
52
+ - [unclecode/llama3-function-call-Q4_K_M_GGFU-240424](https://huggingface.co/unclecode/llama3-function-call-Q4_K_M_GGFU-240424)
53
+ - [unclecode/tinyllama-function-call-lora-adapter-250424](https://huggingface.co/unclecode/tinyllama-function-call-lora-adapter-250424)
54
+ - [unclecode/tinyllama-function-call-16bit-250424](https://huggingface.co/unclecode/tinyllama-function-call-16bit-250424)
55
+ - [unclecode/tinyllama-function-call-Q4_K_M_GGFU-250424](https://huggingface.co/unclecode/tinyllama-function-call-Q4_K_M_GGFU-250424)
56
 
57
+ ## License
58
 
59
+ These models are released under the Apache 2.0 license.