bsc-temu commited on
Commit
0ef7b99
1 Parent(s): ca00581

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -10
README.md CHANGED
@@ -4,7 +4,6 @@ language:
4
  license: apache-2.0
5
  tags:
6
  - "catalan"
7
- - "bne"
8
  - "qa"
9
  datasets:
10
  - "xquad-ca"
@@ -17,18 +16,18 @@ metrics:
17
 
18
  # Catalan RoBERTa-base (BERTa) finetuned for Question Answering on the viquiquad dataset.
19
 
20
- The roberta-base-ca-cased-qa is a Question Answering (QA) model for the Catalan language fine-tuned from the [BERTa](https://huggingface.co/PlanTL-GOB-ES/roberta-base-ca) model, a [RoBERTa](https://arxiv.org/abs/1907.11692) base model pre-trained on a medium-size corpus collected from publicly available corpora and crawlers (check the BERTa model card for more details).
21
 
22
- ## Dataset
23
- The dataset used is a QA dataset in Catalan called [viquiquad](https://huggingface.co/datasets/projecte-aina/viquiquad).
24
-
25
- ## Fine-tuning
26
- TODO
27
 
28
  ## Evaluation and results
29
- TODO
30
 
31
- For the fine-tuning and evaluation details visit the official [GitHub repository]().
 
 
 
 
32
 
33
 
34
  ## Citing
@@ -63,7 +62,7 @@ TODO
63
 
64
  The models published in this repository are intended for a generalist purpose and are available to third parties. These models may have bias and/or any other undesirable distortions.
65
 
66
- When third parties, deploy or provide systems and/or services to other parties using any of these models (or using systems based on these models) or become users of the models, they should note that it is their responsibility to mitigate the risks arising from their use and, in any event, to comply with applicable regulations, including regulations regarding the use of artificial intelligence.
67
 
68
  In no event shall the owner of the models (SEDIA – State Secretariat for digitalization and artificial intelligence) nor the creator (BSC – Barcelona Supercomputing Center) be liable for any results arising from the use made by third parties of these models.
69
 
4
  license: apache-2.0
5
  tags:
6
  - "catalan"
 
7
  - "qa"
8
  datasets:
9
  - "xquad-ca"
16
 
17
  # Catalan RoBERTa-base (BERTa) finetuned for Question Answering on the viquiquad dataset.
18
 
19
+ The **roberta-base-ca-cased-qa** is a Question Answering (QA) model for the Catalan language fine-tuned from the [BERTa](https://huggingface.co/PlanTL-GOB-ES/roberta-base-ca) model, a [RoBERTa](https://arxiv.org/abs/1907.11692) base model pre-trained on a medium-size corpus collected from publicly available corpora and crawlers (check the BERTa model card for more details).
20
 
21
+ ## Datasets
22
+ We used the QA dataset in Catalan called [ViquiQuAD](https://huggingface.co/datasets/projecte-aina/viquiquad) for training and evaluation, and the [XQuAD-ca](https://huggingface.co/datasets/projecte-aina/xquad-ca) test set for evaluation.
 
 
 
23
 
24
  ## Evaluation and results
 
25
 
26
+ | Task | QA (ViquiQuAD) (F1/EM) | QA (XQuAD-ca) (F1/EM) |
27
+ | ------------|:------|:----|
28
+ | BERTa | **86.99/73.25** | **67.81/49.43** |
29
+
30
+ For more details, check the fine-tuning and evaluation scripts in the official [GitHub repository](https://github.com/projecte-aina/berta).
31
 
32
 
33
  ## Citing
62
 
63
  The models published in this repository are intended for a generalist purpose and are available to third parties. These models may have bias and/or any other undesirable distortions.
64
 
65
+ When third parties, deploy or provide systems and/or services to other parties using any of these models (or using systems based on these models) or become users of the models, they should note that it is their responsibility to mitigate the risks arising from their use and, in any event, to comply with applicable regulations, including regulations regarding the use of artificial intelligence.
66
 
67
  In no event shall the owner of the models (SEDIA – State Secretariat for digitalization and artificial intelligence) nor the creator (BSC – Barcelona Supercomputing Center) be liable for any results arising from the use made by third parties of these models.
68