Upload model
Browse files- .gitattributes +6 -0
- Home-1B-v2.f16.gguf +3 -0
- Home-1B-v2.q2_k.gguf +3 -0
- Home-1B-v2.q3_k_m.gguf +3 -0
- Home-1B-v2.q4_k_m.gguf +3 -0
- Home-1B-v2.q5_k_m.gguf +3 -0
- Home-1B-v2.q8_0.gguf +3 -0
- README.md +50 -0
.gitattributes
CHANGED
@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
Home-1B-v2.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
37 |
+
Home-1B-v2.q2_k.gguf filter=lfs diff=lfs merge=lfs -text
|
38 |
+
Home-1B-v2.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
39 |
+
Home-1B-v2.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
40 |
+
Home-1B-v2.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
41 |
+
Home-1B-v2.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
Home-1B-v2.f16.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2c527217f9a426239b3a83966446c6ea9be2f3ba2ee6cbbdc74c6cc2df008790
|
3 |
+
size 2839540160
|
Home-1B-v2.q2_k.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:61d555b6498518c8350a66575503e4c53ea7f0767b8e594a36ad97027fd72fb1
|
3 |
+
size 582316512
|
Home-1B-v2.q3_k_m.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ab59bd88dbe29907f7771cd78953882d0df3b811aff5da2bf8707169b1095e70
|
3 |
+
size 741863904
|
Home-1B-v2.q4_k_m.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a71c0c1d4423892c897bcf8b3492b28b0d50f8504e09f4d26da708adec80bf0b
|
3 |
+
size 893546976
|
Home-1B-v2.q5_k_m.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4e5daeb8abc392853265f536b6ad9b9a9d8341af428344b1b42c849efbb55813
|
3 |
+
size 1026191840
|
Home-1B-v2.q8_0.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c9c5659f1e3a291c8c27cb2be9fce8b90d5aaf918dc8d80f08b3f512ceb72693
|
3 |
+
size 1510470112
|
README.md
ADDED
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
datasets: []
|
3 |
+
license: cc-by-nc-4.0
|
4 |
+
language:
|
5 |
+
- en
|
6 |
+
tags:
|
7 |
+
- automation
|
8 |
+
- home
|
9 |
+
- assistant
|
10 |
+
pipeline_tag: text-generation
|
11 |
+
---
|
12 |
+
# Home 1B v2
|
13 |
+
The "Home" model is a fine tuning of the Phi-1.5 model from Microsoft. The model is able to control devices in the user's house via a Home Assistant integragion. The fine tuning dataset a [custom curated dataset](https://github.com/acon96/home-llm) designed to teach the model function calling.
|
14 |
+
|
15 |
+
The model is quantized using Lama.cpp in order to enable running the model in super low resource environments that are common with Home Assistant installations such as Rapsberry Pis.
|
16 |
+
|
17 |
+
The model can be used as an "instruct" type model using the ChatML prompt format. The system prompt is used to provide information about the state of the Home Assistant installation including available devices and callable services.
|
18 |
+
|
19 |
+
Example "system" prompt:
|
20 |
+
```
|
21 |
+
You are 'Al', a helpful AI Assistant that controls the devices in a house. Complete the following task as instructed with the information provided only.
|
22 |
+
Services: light.turn_off(), light.turn_on(rgb_color,brightness), fan.turn_on(), fan.turn_off()
|
23 |
+
Devices:
|
24 |
+
light.office 'Office Light' = on;80%
|
25 |
+
fan.office 'Office fan' = off
|
26 |
+
light.kitchen 'Kitchen Light' = on;80%;red
|
27 |
+
light.bedroom 'Bedroom Light' = off
|
28 |
+
```
|
29 |
+
|
30 |
+
Output from the model will consist of a response that should be relayed back to the user, along with an optional code block that will invoke different Home Assistant "services". The output format from the model for function calling is as follows:
|
31 |
+
|
32 |
+
`````
|
33 |
+
turning on the kitchen lights for you now
|
34 |
+
```homeassistant
|
35 |
+
{ "service": "light.turn_on", "target_device": "light.kitchen" }
|
36 |
+
```
|
37 |
+
`````
|
38 |
+
|
39 |
+
## Training
|
40 |
+
The model was trained as a full fine-tuning on an RTX 3090 (24GB). It was trained for ~2x as many tokens as the v1 version of the model.
|
41 |
+
|
42 |
+
## Evaluation
|
43 |
+
This model acheives a 88.52% score for JSON function calling accuracy on the test dataset.
|
44 |
+
The v1 model acheives a 76.78% score on the same test.
|
45 |
+
|
46 |
+
## Datasets
|
47 |
+
Snythetic Dataset for SFT - https://github.com/acon96/home-llm
|
48 |
+
|
49 |
+
## License
|
50 |
+
This model is a fine-tuning of the Microsoft Phi model series (MIT License) and utilizes datasets thare are licensed under CC BY-NC-4.0. As such this model is released under the same non-commerical Creative Commons License. The fine-tuned model is shared FOR RESEARCH PURPOSES ONLY. It is not to be used in any sort of commercial capacity.
|