File size: 1,793 Bytes
ba5c82b
 
dc8b4c4
 
 
 
 
 
93503f9
 
 
 
 
 
 
 
 
 
 
 
 
ba5c82b
 
 
98f5957
faed806
98f5957
 
0023815
 
 
 
 
 
 
 
 
 
 
 
 
 
dc8b4c4
 
 
 
ba5c82b
d230c7c
dc8b4c4
 
 
d11c411
 
 
 
 
 
 
 
 
7e17ac9
 
 
 
 
d11c411
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
---
library_name: transformers
license: apache-2.0
datasets:
- gretelai/synthetic_text_to_sql
- NickyNicky/synthetic_text_to_sql_format_chatML_gemma
language:
- en

widget:
- text: |
    <bos><start_of_turn>system
    You are a helpful AI assistant.
    you are a sql expert who responds in json format.<end_of_turn>
    <start_of_turn>user
    ## prompt:
    What is the total gold production by 'Site B' in the 'production' table?
    
    ## sql context:
    CREATE TABLE production (id INT, site VARCHAR(50), year INT, gold_production INT, silver_production INT);<end_of_turn>
    <start_of_turn>model
---


<p align="center">
  <img src="https://cdn-uploads.huggingface.co/production/uploads/641b435ba5f876fe30c5ae0a/Fy2GvAheKCnd3Jj3TbrPG.png" alt="" style="width: 95%; max-height: 750px;">
</p>

## Metrics.
```
TrainOutput(global_step=2509,
  training_loss=0.2509715025906736,
  metrics={'train_runtime': 22783.0743,
    'train_samples_per_second': 8.81,
    'train_steps_per_second': 0.11,
    'total_flos': 1.820581902144553e+18,
    'train_loss': 0.2509715025906736,
    'epoch': 2.01
    }
)
```

## Take dataset.
```
gretelai/synthetic_text_to_sql
```

## Dataset format gemma fine tune.
```
NickyNicky/synthetic_text_to_sql_format_chatML_gemma
```

## colab examples and Gradio.
```
https://colab.research.google.com/drive/1-0PsRAqTum2UuvsXb9JtXxLISIUWd8zv?usp=sharing
```

## gradio colab.
<p align="center">
  <img src="https://cdn-uploads.huggingface.co/production/uploads/641b435ba5f876fe30c5ae0a/X2rf3Z7jJ2WUI7LANw4IH.png" alt="" style="width: 95%; max-height: 750px;">
</p>

## $ train
<p align="center">
  <img src="https://cdn-uploads.huggingface.co/production/uploads/641b435ba5f876fe30c5ae0a/tLhUyV2uW44-Cf0vwXFbd.png" alt="" style="width: 95%; max-height: 750px;">
</p>