File size: 1,036 Bytes
d9918d0
0fd615e
b48e821
0fd615e
3ab0634
 
b48e821
0fd615e
3ab0634
 
b48e821
5b548f6
d9918d0
f0c9806
4e6fd44
 
 
 
 
 
 
 
 
 
 
 
 
374c6af
4e6fd44
 
 
5b548f6
 
2cc4523
63ea416
e6745fc
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
---
language: ger
license: apache-2.0
widget:
- text: '###Context

    Der Patient hat Brustkrebs.


    ###Answer'
  example_title: Patient mit Brustkreb
pipeline_tag: text-generation
---
tiny Llama trained on BRO dataset with NER tags, Labels and Tokens. 

WCETrainer r100_O10_f100 , run lemon-fog-11 checkpoint-1623. 

- EVAL

AVGf1 = 93%, overall_f1 = 82%

- TEST

'DIAG': {'precision': 0.710079275198188, 'recall': 0.7674418604651163, 'f1': 0.7376470588235293, 'number': 817}, 

'MED': {'precision': 0.9379084967320261, 'recall': 0.959866220735786, 'f1': 0.9487603305785124, 'number': 299},

'TREAT': {'precision': 0.8542914171656687, 'recall': 0.856, 'f1': 0.8551448551448552, 'number': 500}, 

'overall_precision': 0.7672955974842768, 'overall_recall': 0.8304455445544554, 'overall_f1': 0.7976225854383358, 'overall_accuracy': 0.9280119624038735}

average_f1 = 0.8471840815156323

- Prompt Format (see example):

### ### Context\n{Nachricht}\n\n### Answer


def context_text(text):
    return f"### Context\n{text}\n\n### Answer"