kyujinpy commited on
Commit
e7a2678
1 Parent(s): dd55169

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +58 -0
README.md CHANGED
@@ -1,3 +1,61 @@
1
  ---
 
 
 
 
 
 
2
  license: cc-by-nc-sa-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - ko
4
+ datasets:
5
+ - kyujinpy/KOR-OpenOrca-Platypus-v3
6
+ library_name: transformers
7
+ pipeline_tag: text-generation
8
  license: cc-by-nc-sa-4.0
9
  ---
10
+
11
+ # **Ko-PlatYi-6B**
12
+ <img src='./Ko-PlatYi.png' width=256>
13
+
14
+ ## Model Details
15
+
16
+ **Model Developers** Kyujin Han (kyujinpy)
17
+
18
+ **Input** Models input text only.
19
+
20
+ **Output** Models generate text only.
21
+
22
+ **Model Architecture**
23
+ Ko-PlatYi-6B is an auto-regressive language model based on the Yi-34B transformer architecture.
24
+
25
+ **Blog Link**
26
+ Blog: [Coming soon...]
27
+ Github: [Coming soon...]
28
+
29
+ **Base Model**
30
+ [beomi/Yi-Ko-6B](https://huggingface.co/beomi/Yi-Ko-6B)
31
+
32
+ **Training Dataset**
33
+ [kyujinpy/KOR-OpenOrca-Platypus-v3](https://huggingface.co/datasets/kyujinpy/KOR-OpenOrca-Platypus-v3).
34
+
35
+ # **Model Benchmark**
36
+
37
+ ## Open leaderboard
38
+ - Follow up as [link](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard).
39
+
40
+ | Model | Average | ARC | HellaSwag | MMLU | TruthfulQA | CommonGen-V2 |
41
+ | --- | --- | --- | --- | --- | --- | --- |
42
+ | **Ko-PlatYi-6B** | NaN | NaN | NaN | NaN | NaN | NaN |
43
+ | **Yi-Ko-6B** | 48.79 | 41.04 | 53.39 | 46.28 | 41.64 | 61.63 |
44
+
45
+ # Implementation Code
46
+ ```python
47
+ ### KO-Platypus
48
+ from transformers import AutoModelForCausalLM, AutoTokenizer
49
+ import torch
50
+
51
+ repo = "kyujinpy/Ko-PlatYi-6B"
52
+ OpenOrca = AutoModelForCausalLM.from_pretrained(
53
+ repo,
54
+ return_dict=True,
55
+ torch_dtype=torch.float16,
56
+ device_map='auto'
57
+ )
58
+ OpenOrca_tokenizer = AutoTokenizer.from_pretrained(repo)
59
+ ```
60
+
61
+ ---