Text Generation
Transformers
Safetensors
Serbian
mistral
mergekit
Merge
text-generation-inference
conversational
Inference Endpoints
datatab commited on
Commit
fa2531f
1 Parent(s): e8aefdb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -5
README.md CHANGED
@@ -20,11 +20,38 @@ tags:
20
  > Results obtained through the Serbian LLM evaluation, released by Aleksa Gordić: [serbian-llm-eval](https://github.com/gordicaleksa/serbian-llm-eval)
21
  > * Evaluation was conducted on a 4-bit version of the model due to hardware resource constraints.
22
 
23
- | MODEL | ARC-E | ARC-C | Hellaswag | BoolQ | Winogrande | OpenbookQA | PiQA |
24
- |-----------|-------|-------|-----------|-------|------------|------------|-------|
25
- | [Yugo55-GPT-v4-4bit](https://huggingface.co/datatab/Yugo55-GPT-v4-4bit/) | **51.41** | **36.00** | **57.51** | **80.92** | **65.75** | **34.70** | **70.54** |
26
-
27
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
28
 
29
 
30
 
 
20
  > Results obtained through the Serbian LLM evaluation, released by Aleksa Gordić: [serbian-llm-eval](https://github.com/gordicaleksa/serbian-llm-eval)
21
  > * Evaluation was conducted on a 4-bit version of the model due to hardware resource constraints.
22
 
23
+ <table>
24
+ <tr>
25
+ <th>MODEL</th>
26
+ <th>ARC-E</th>
27
+ <th>ARC-C</th>
28
+ <th>Hellaswag</th>
29
+ <th>BoolQ</th>
30
+ <th>Winogrande</th>
31
+ <th>OpenbookQA</th>
32
+ <th>PiQA</th>
33
+ </tr>
34
+ <tr>
35
+ <td><a href="https://huggingface.co/datatab/Yugo55-GPT-v4-4bit/">Yugo55-GPT-v4-4bit</a></td>
36
+ <td>51.41</td>
37
+ <td>36.00</td>
38
+ <td>57.51</td>
39
+ <td>80.92</td>
40
+ <td>65.75</td>
41
+ <td>34.70</td>
42
+ <td><strong>70.54</strong></td>
43
+ </tr>
44
+ <tr>
45
+ <td><a href="https://huggingface.co/datatab/Yugo55A-GPT/">Yugo55A-GPT</a></td>
46
+ <td><strong>51.52</strong></td>
47
+ <td><strong>37.78</strong></td>
48
+ <td><strong>57.52</strong></td>
49
+ <td><strong>84.40</strong></td>
50
+ <td><strong>65.43</strong></td>
51
+ <td><strong>35.60</strong></td>
52
+ <td><strong>69.43</strong></td>
53
+ </tr>
54
+ </table>
55
 
56
 
57