File size: 1,000 Bytes
2f22782
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
74625f5
 
 
 
 
 
 
f9d3528
 
 
 
2f22782
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
---

title: De Identification Leaderboard
emoji: 🏃
colorFrom: pink
colorTo: yellow
sdk: streamlit
sdk_version: 1.35.0
app_file: app.py
pinned: false
license: mit
---


Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference




# de-identification-leaderboard
## run web local 
### key
creat file  `.streamlit\secrets.toml`
```

hf = "your token"

```

```

streamlit run app.py

```


##  leaderboard data
score wil save to huggingface dataset
[zhaorui-nb/leaderboard-score](https://huggingface.co/datasets/zhaorui-nb/leaderboard-score)


## submit 
###  filename format 
replace '/' to '@'
```

[{Organization@Model}][{Dataaset}][{Method}]{Filename}.txt"

```

### line in answer txt (tsv)
```

{file_name}\t{label_type}\t{label_start}\t{label_end}\t{label_text}\n

```

## Support dataset
```

Setting1

Setting2

Setting3

```


# cli batch eval tool 
```

python .\batch_eval_script.py ..\deid_resaut

```