mmarimon commited on
Commit
5c06509
1 Parent(s): fe6ec0e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +48 -16
README.md CHANGED
@@ -20,19 +20,64 @@ inference:
20
  ---
21
 
22
  # Spanish RoBERTa-large trained on BNE finetuned for CAPITEL Named Entity Recognition (NER) dataset.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
  RoBERTa-large-bne is a transformer-based masked language model for the Spanish language. It is based on the [RoBERTa](https://arxiv.org/abs/1907.11692) large model and has been pre-trained using the largest Spanish corpus known to date, with a total of 570GB of clean and deduplicated text processed for this work, compiled from the web crawlings performed by the [National Library of Spain (Biblioteca Nacional de España)](http://www.bne.es/en/Inicio/index.html) from 2009 to 2019.
24
 
25
  Original pre-trained model can be found here: https://huggingface.co/BSC-TeMU/roberta-large-bne
26
 
27
- ## Dataset
 
 
 
 
 
 
 
28
  The dataset used is the one from the [CAPITEL competition at IberLEF 2020](https://sites.google.com/view/capitel2020) (sub-task 1).
29
 
30
- ## Evaluation and results
31
  F1 Score: 0.8998
32
 
33
  For evaluation details visit our [GitHub repository](https://github.com/PlanTL-GOB-ES/lm-spanish).
34
 
35
- ## Citing
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
36
  If you use this model, please cite our [paper](http://journal.sepln.org/sepln/ojs/ojs/index.php/pln/article/view/6405):
37
  ```
38
  @article{,
@@ -50,21 +95,8 @@ Intelligence (SEDIA) within the framework of the Plan-TL.},
50
  url = {https://upcommons.upc.edu/handle/2117/367156#.YyMTB4X9A-0.mendeley},
51
  year = {2022},
52
  }
53
-
54
  ```
55
 
56
- ## Copyright
57
-
58
- Copyright by the Spanish State Secretariat for Digitalization and Artificial Intelligence (SEDIA) (2022)
59
-
60
- ## Licensing information
61
-
62
- [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0)
63
-
64
- ## Funding
65
-
66
- This work was funded by the Spanish State Secretariat for Digitalization and Artificial Intelligence (SEDIA) within the framework of the Plan-TL.
67
-
68
  ## Disclaimer
69
 
70
  The models published in this repository are intended for a generalist purpose and are available to third parties. These models may have bias and/or any other undesirable distortions.
 
20
  ---
21
 
22
  # Spanish RoBERTa-large trained on BNE finetuned for CAPITEL Named Entity Recognition (NER) dataset.
23
+
24
+ ## Table of contents
25
+ <details>
26
+ <summary>Click to expand</summary>
27
+
28
+ - [Model description](#model-description)
29
+ - [Intended uses and limitations](#intended-use)
30
+ - [How to use](#how-to-use)
31
+ - [Limitations and bias](#limitations-and-bias)
32
+ - [Training](#training)
33
+ - [Evaluation](#evaluation)
34
+ - [Additional information](#additional-information)
35
+ - [Author](#author)
36
+ - [Contact information](#contact-information)
37
+ - [Copyright](#copyright)
38
+ - [Licensing information](#licensing-information)
39
+ - [Funding](#funding)
40
+ - [Citing information](#citing-information)
41
+ - [Disclaimer](#disclaimer)
42
+
43
+ ## Model description
44
  RoBERTa-large-bne is a transformer-based masked language model for the Spanish language. It is based on the [RoBERTa](https://arxiv.org/abs/1907.11692) large model and has been pre-trained using the largest Spanish corpus known to date, with a total of 570GB of clean and deduplicated text processed for this work, compiled from the web crawlings performed by the [National Library of Spain (Biblioteca Nacional de España)](http://www.bne.es/en/Inicio/index.html) from 2009 to 2019.
45
 
46
  Original pre-trained model can be found here: https://huggingface.co/BSC-TeMU/roberta-large-bne
47
 
48
+ ## Intended uses and limitations
49
+
50
+ ## How to use
51
+
52
+ ## Limitations and bias
53
+ At the time of submission, no measures have been taken to estimate the bias embedded in the model. However, we are well aware that our models may be biased since the corpora have been collected using crawling techniques on multiple web sources. We intend to conduct research in these areas in the future, and if completed, this model card will be updated.
54
+
55
+ ## Training
56
  The dataset used is the one from the [CAPITEL competition at IberLEF 2020](https://sites.google.com/view/capitel2020) (sub-task 1).
57
 
58
+ ## Evaluation
59
  F1 Score: 0.8998
60
 
61
  For evaluation details visit our [GitHub repository](https://github.com/PlanTL-GOB-ES/lm-spanish).
62
 
63
+ ## Additional information
64
+
65
+ ### Author
66
+ Text Mining Unit (TeMU) at the Barcelona Supercomputing Center (bsc-temu@bsc.es)
67
+
68
+ ### Contact information
69
+ For further information, send an email to <plantl-gob-es@bsc.es>
70
+
71
+ ### Copyright
72
+ Copyright by the Spanish State Secretariat for Digitalization and Artificial Intelligence (SEDIA) (2022)
73
+
74
+ ### Licensing information
75
+ [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0)
76
+
77
+ ### Funding
78
+ This work was funded by the Spanish State Secretariat for Digitalization and Artificial Intelligence (SEDIA) within the framework of the Plan-TL.
79
+
80
+ ## Citing information
81
  If you use this model, please cite our [paper](http://journal.sepln.org/sepln/ojs/ojs/index.php/pln/article/view/6405):
82
  ```
83
  @article{,
 
95
  url = {https://upcommons.upc.edu/handle/2117/367156#.YyMTB4X9A-0.mendeley},
96
  year = {2022},
97
  }
 
98
  ```
99
 
 
 
 
 
 
 
 
 
 
 
 
 
100
  ## Disclaimer
101
 
102
  The models published in this repository are intended for a generalist purpose and are available to third parties. These models may have bias and/or any other undesirable distortions.