airesearch
/

WangchanLion7B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mrp commited on Dec 26, 2023

Commit

ad326e0

•

1 Parent(s): 67bc146

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -89,9 +89,9 @@ We performed human and machine evaluations on XQuAD zero-shot and one-shot setti
 ## iAPP Wiki QA
 |      Model     | Exact Match (Zero-shot) | F1 (Zero-shot) | Exact Match (One-shot) | F1 (One-shot) |
 |:--------------:|:-----------------------:|:--------------:|:----------------------:|:-------------:|
-| openthaigpt7B  |         22.0568         |     40.0696    |         31.3938        |    47.9775    |
-| SeaLLM7B       |          8.2544         |     34.4038    |         40.0541        |    58.2673    |
-| WangchanLion7B |       **55.4804**       |   **67.9262**  |       **56.4276**      |  **68.8471**  |
 # What WangchanLion offers:
 - Transparent pretrained model: The development of SEA-LION is community-driven, with different ASEAN collaborators contributing pretraining datasets. The SEA-LION developers ensure that all datasets are safe and can be utilized without commercial restrictions. This transparency extends to the provision of pretraining code, ensuring anyone can replicate SEA-LION using the provided datasets.

 ## iAPP Wiki QA
 |      Model     | Exact Match (Zero-shot) | F1 (Zero-shot) | Exact Match (One-shot) | F1 (One-shot) |
 |:--------------:|:-----------------------:|:--------------:|:----------------------:|:-------------:|
+| openthaigpt7B  |         22.06         |     40.07    |         31.39        |    47.98    |
+| SeaLLM7B       |          8.25         |     34.40    |         40.05        |    58.27    |
+| WangchanLion7B |       **55.48**       |   **67.93**  |       **56.43**      |  **68.85**  |
 # What WangchanLion offers:
 - Transparent pretrained model: The development of SEA-LION is community-driven, with different ASEAN collaborators contributing pretraining datasets. The SEA-LION developers ensure that all datasets are safe and can be utilized without commercial restrictions. This transparency extends to the provision of pretraining code, ensuring anyone can replicate SEA-LION using the provided datasets.