Hugging Face's logo

MulaBR
/
Mula-4x160-v0.1

Text Generation
Transformers
Safetensors
Portuguese
mixtral
text-generation-inference
Eval Results
Carbon Emissions
Inference Endpoints
Model card Files Community
2
nicholasKluge commited on
Commit
1a3de10
•
1 Parent(s): e2295f8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -19,6 +19,13 @@ tags: []
19
  | 400000 | 2.46 | 11.72 | 0.040 |
20
 
21
 
 
 
 
 
 
 
 
22
  | | **ASSIN2 RTE** | **ASSIN2 STS** | **BLUEX** | **ENEM** | **FAQUAD NLI** | **HateBR** | **OAB Exams** | **Average** |
23
  |-------------------|----------------|----------------|-----------|----------|----------------|------------|---------------|-------------|
24
  | **TTL-460m** | 53.93 | 12.66 | 22.81 | 19.87 | 49.01 | 33.59 | 27.06 | 31.27 |
 
19
  | 400000 | 2.46 | 11.72 | 0.040 |
20
 
21
 
22
+ | | **ARC** | **HellaSwag** | **MMLU** | **TruthfulQA** | **Average** |
23
+ |------------------|-----------|---------------|-----------|----------------|-------------|
24
+ | **TTL-460m** | 29.40 | 33.00 | 28.55 | 41.10 | 33.01 |
25
+ | **TTL-160m** | 26.15 | 29.29 | 28.11 | 41.12 | 31.16 |
26
+ | **Mula-4x160m** | 27.09 | 31.41 | 28.15 | 39.81 | 31.61 |
27
+
28
+
29
  | | **ASSIN2 RTE** | **ASSIN2 STS** | **BLUEX** | **ENEM** | **FAQUAD NLI** | **HateBR** | **OAB Exams** | **Average** |
30
  |-------------------|----------------|----------------|-----------|----------|----------------|------------|---------------|-------------|
31
  | **TTL-460m** | 53.93 | 12.66 | 22.81 | 19.87 | 49.01 | 33.59 | 27.06 | 31.27 |