oguzhandoganoglu commited on
Commit
a1f3e11
1 Parent(s): e6462f9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +86 -0
README.md CHANGED
@@ -2,6 +2,92 @@
2
  license: llama3
3
  language:
4
  - tr
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  ---
6
  # CERE-LLMA-3-8b-TR
7
 
 
2
  license: llama3
3
  language:
4
  - tr
5
+ model-index:
6
+ - name: Kocdigital-LLM-8b-v0.1
7
+ results:
8
+ - task:
9
+ type: text-generation
10
+ name: Text Generation
11
+ dataset:
12
+ name: AI2 Reasoning Challenge TR
13
+ type: ai2_arc
14
+ config: ARC-Challenge
15
+ split: test
16
+ args:
17
+ num_few_shot: 25
18
+ metrics:
19
+ - type: acc
20
+ value: 44.03
21
+ name: accuracy
22
+ - task:
23
+ type: text-generation
24
+ name: Text Generation
25
+ dataset:
26
+ name: HellaSwag TR
27
+ type: hellaswag
28
+ split: validation
29
+ args:
30
+ num_few_shot: 10
31
+ metrics:
32
+ - type: acc
33
+ value: 46.73
34
+ name: accuracy
35
+ - task:
36
+ type: text-generation
37
+ name: Text Generation
38
+ dataset:
39
+ name: MMLU TR
40
+ type: cais/mmlu
41
+ config: all
42
+ split: test
43
+ args:
44
+ num_few_shot: 5
45
+ metrics:
46
+ - type: acc
47
+ value: 49.11
48
+ name: accuracy
49
+ - task:
50
+ type: text-generation
51
+ name: Text Generation
52
+ dataset:
53
+ name: TruthfulQA TR
54
+ type: truthful_qa
55
+ config: multiple_choice
56
+ split: validation
57
+ args:
58
+ num_few_shot: 0
59
+ metrics:
60
+ - type: acc
61
+ name: accuracy
62
+ value: 48.21
63
+ - task:
64
+ type: text-generation
65
+ name: Text Generation
66
+ dataset:
67
+ name: Winogrande TR
68
+ type: winogrande
69
+ config: winogrande_xl
70
+ split: validation
71
+ args:
72
+ num_few_shot: 10
73
+ metrics:
74
+ - type: acc
75
+ value: 54.98
76
+ name: accuracy
77
+ - task:
78
+ type: text-generation
79
+ name: Text Generation
80
+ dataset:
81
+ name: GSM8k TR
82
+ type: gsm8k
83
+ config: main
84
+ split: test
85
+ args:
86
+ num_few_shot: 5
87
+ metrics:
88
+ - type: acc
89
+ value: 51.78
90
+ name: accuracy
91
  ---
92
  # CERE-LLMA-3-8b-TR
93