Hugging Face's logo

PantagrueLLM
/
jargon-legal-4096

Fill-Mask
Transformers
PyTorch
French
jargon
linformer
legal
RoBERTa
custom_code
Model card Files Community
a-mannion commited on
Commit
6f87d84
•
1 Parent(s): 5e956eb

update evaluation URLs

Browse files
Files changed (1) hide show
  1. README.md +1 -2
README.md CHANGED
@@ -43,11 +43,10 @@ The Jargon models were evaluated on an range of specialized downstream tasks.
43
 
44
  Results averaged across five funs with varying random seeds.
45
 
46
- | **Task Name** | ECtHR-FR | OACS | SJP |
47
  |-------------------------|:-----------------------:|:-----------------------:|:-----------------------:|
48
  | **Task Type** | Document Classification | Document Classification | Document Classification |
49
  | **Metric** | Macro-F1 | Macro-F1 | Macro-F1 |
50
- |-------------------------|:-----------------------:|:-----------------------:|:-----------------------:|
51
  | jargon-general-base | 42.9 | 50.8 | 55.1 |
52
  | jargon-multidomain-base | 44.5 | 55.6 | 58.1 |
53
  | jargon-general-legal | 43.1 | 49.9 | 54.5 |
 
43
 
44
  Results averaged across five funs with varying random seeds.
45
 
46
+ | |[ECtHR-FR](https://huggingface.co/datasets/audibeal/fr-echr)|[OACS](https://www.jeuxdemots.org/OACS/oacs.php)|[SJP](https://aclanthology.org/2021.nllp-1.3/)|
47
  |-------------------------|:-----------------------:|:-----------------------:|:-----------------------:|
48
  | **Task Type** | Document Classification | Document Classification | Document Classification |
49
  | **Metric** | Macro-F1 | Macro-F1 | Macro-F1 |
 
50
  | jargon-general-base | 42.9 | 50.8 | 55.1 |
51
  | jargon-multidomain-base | 44.5 | 55.6 | 58.1 |
52
  | jargon-general-legal | 43.1 | 49.9 | 54.5 |