mudler commited on
Commit
665828a
·
verified ·
1 Parent(s): 31eb74d

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -0
README.md ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: llama3
3
+ tags:
4
+ - LocalAI
5
+ ---
6
+ # LocalAI-Llama3.1-8b-Function-Call-v0.3
7
+
8
+ [![local-ai-banner.png](https://cdn-uploads.huggingface.co/production/uploads/647374aa7ff32a81ac6d35d4/bXvNcxQqQ-wNAnISmx3PS.png)](https://localai.io)
9
+
10
+ ![LocalAIFCALL](https://cdn-uploads.huggingface.co/production/uploads/647374aa7ff32a81ac6d35d4/us5JKi9z046p8K-cn_M0w.webp)
11
+
12
+ This model is a fine-tune on a custom dataset + glaive to work specifically and leverage all the [LocalAI](https://localai.io) features of constrained grammar.
13
+
14
+ Specifically, the model once enters in tools mode will always reply with JSON.
15
+
16
+ To run on LocalAI:
17
+
18
+ ```
19
+ local-ai run huggingface://mudler/LocalAI-Llama3.1-8b-Function-Call-v0.3-GGUF/localai-q4_k_m.yaml
20
+ ```
21
+
22
+ If you like my work, consider up donating so can get resources for my fine-tunes!