Update README.md
Browse files
README.md
CHANGED
@@ -31,9 +31,9 @@ https://openthaigpt.aieat.or.th/" width="200px">
|
|
31 |
| **facebook_beleble_tha** | 25.00% | 45.00% | 34.50% | 39.50% | 70.00% | 13.50% | 51.00% | N/A | 27.00% | 24.50% | 63.00% | 50.00% | 72.50% | 65.00% | 74.00% | 63.50% | 77.00% | 90.00% |
|
32 |
| **xcopa_th_200** | 45.00% | 56.50% | 49.50% | 51.50% | 74.50% | 26.50% | 47.00% | N/A | 51.50% | 48.50% | 68.50% | 64.00% | 82.00% | 68.00% | 74.00% | 64.00% | 80.00% | 86.00% |
|
33 |
| **xnli2.0_tha** | 33.50% | 34.50% | 39.50% | 31.00% | 47.00% | 21.00% | 43.00% | N/A | 37.50% | 33.50% | 16.00% | 50.00% | 69.00% | 53.00% | 54.50% | 50.00% | 68.00% | 68.50% |
|
34 |
-
| **
|
35 |
-
| **
|
36 |
-
|
37 |
| **Average Score** | 23.83% | 37.27% | 38.40% | 40.33% | 55.87% | 18.06% | 33.56% | N/A | 27.44% | 23.75% | 37.28% | 43.07% | 60.68% | 52.30% | 52.89% | 50.65% | 56.81% | 68.32% |
|
38 |
|
39 |
## Licenses
|
@@ -49,17 +49,39 @@ https://openthaigpt.aieat.or.th/" width="200px">
|
|
49 |
- A Discord server for discussion and support [here](https://discord.gg/rUTp6dfVUF)
|
50 |
- E-mail: kobkrit@aieat.or.th
|
51 |
|
52 |
-
##
|
53 |
-
Prompt format is Llama2
|
54 |
```
|
55 |
-
<s>[INST] <<SYS
|
56 |
-
system_prompt
|
57 |
<</SYS>>
|
58 |
|
59 |
-
|
|
|
|
|
|
|
60 |
```
|
61 |
-
System prompt:
|
62 |
You are a question answering assistant. Answer the question as truthful and helpful as possible คุณคือผู้ช่วยตอบคำถาม จงตอบคำถามอย่างถูกต้องและมีประโยชน์ที่สุด
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
63 |
|
64 |
## How to use
|
65 |
|
|
|
31 |
| **facebook_beleble_tha** | 25.00% | 45.00% | 34.50% | 39.50% | 70.00% | 13.50% | 51.00% | N/A | 27.00% | 24.50% | 63.00% | 50.00% | 72.50% | 65.00% | 74.00% | 63.50% | 77.00% | 90.00% |
|
32 |
| **xcopa_th_200** | 45.00% | 56.50% | 49.50% | 51.50% | 74.50% | 26.50% | 47.00% | N/A | 51.50% | 48.50% | 68.50% | 64.00% | 82.00% | 68.00% | 74.00% | 64.00% | 80.00% | 86.00% |
|
33 |
| **xnli2.0_tha** | 33.50% | 34.50% | 39.50% | 31.00% | 47.00% | 21.00% | 43.00% | N/A | 37.50% | 33.50% | 16.00% | 50.00% | 69.00% | 53.00% | 54.50% | 50.00% | 68.00% | 68.50% |
|
34 |
+
| **ONET M3** | 17.85% | 38.86% | 34.11% | 39.36% | 56.15% | 15.58% | 23.92% | N/A | 21.79% | 19.56% | 21.37% | 37.91% | 49.97% | 55.99% | 57.41% | 52.73% | 40.60% | 63.87% |
|
35 |
+
| **ONET M6** | 21.14% | 28.87% | 22.53% | 23.32% | 42.85% | 15.09% | 19.48% | N/A | 16.96% | 20.67% | 28.64% | 34.44% | 46.29% | 45.53% | 50.23% | 34.79% | 38.49% | 48.56% |
|
36 |
+
|----------------------------------|-----------------------|------------------------|-------------------------|--------------------------|--------------------------|------------------|------------------|--------------------|----------------|-------------------|--------------------|------------|----------|----------------|----------------|--------------------|---------------------|-------------------|
|
37 |
| **Average Score** | 23.83% | 37.27% | 38.40% | 40.33% | 55.87% | 18.06% | 33.56% | N/A | 27.44% | 23.75% | 37.28% | 43.07% | 60.68% | 52.30% | 52.89% | 50.65% | 56.81% | 68.32% |
|
38 |
|
39 |
## Licenses
|
|
|
49 |
- A Discord server for discussion and support [here](https://discord.gg/rUTp6dfVUF)
|
50 |
- E-mail: kobkrit@aieat.or.th
|
51 |
|
52 |
+
## Prompt Format
|
53 |
+
Prompt format is based on Llama2 with a small modification (Adding "###" to specify the context part)
|
54 |
```
|
55 |
+
<s>[INST] <<SYS>
|
56 |
+
{system_prompt}
|
57 |
<</SYS>>
|
58 |
|
59 |
+
{human_turn1}###{context_turn1} [/INST]{assistant_turn1}</s><s>{human_turn2}###{context_turn2} [/INST] ...
|
60 |
+
```
|
61 |
+
|
62 |
+
### System prompt:
|
63 |
```
|
|
|
64 |
You are a question answering assistant. Answer the question as truthful and helpful as possible คุณคือผู้ช่วยตอบคำถาม จงตอบคำถามอย่างถูกต้องและมีประโยชน์ที่สุด
|
65 |
+
```
|
66 |
+
|
67 |
+
### Single Turn Conversation Example
|
68 |
+
```
|
69 |
+
<s>[INST] <<SYS>
|
70 |
+
You are a question answering assistant. Answer the question as truthful and helpful as possible คุณคือผู้ช่วยตอบคำถาม จงตอบคำถามอย่างถูกต้องและมีประโยชน์ที่สุด
|
71 |
+
<</SYS>>
|
72 |
+
|
73 |
+
สวัสดี [/INST]
|
74 |
+
```
|
75 |
+
|
76 |
+
### Single Turn Conversation with Context (RAG) Example
|
77 |
+
```
|
78 |
+
<s>[INST] <<SYS>
|
79 |
+
You are a question answering assistant. Answer the question as truthful and helpful as possible คุณคือผู้ช่วยตอบคำถาม จงตอบคำถามอย่างถูกต้องและมีประโยชน์ที่สุด
|
80 |
+
<</SYS>>
|
81 |
+
|
82 |
+
กรุงเทพมีพื้นที่เท่าไร่###กรุงเทพมหานคร เป็นเมืองหลวง นครและมหานครที่มีประชากรมากที่สุดของประเทศไทย กรุงเทพมหานครมีพื้นที่ทั้งหมด 1,568.737 ตร.กม. มีประชากรตามทะเบียนราษฎรกว่า 8 ล้านคน [/INST]
|
83 |
+
```
|
84 |
+
|
85 |
|
86 |
## How to use
|
87 |
|