Pablogps commited on
Commit
36389fb
1 Parent(s): 843ce7b

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -0
README.md ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: es
3
+ license: CC-BY 4.0
4
+ tags:
5
+ - spanish
6
+ - roberta
7
+ - ner
8
+ ---
9
+
10
+ This checkpoint has been trained for the POS task using the CoNLL 2002-es dataset.
11
+
12
+ This checkpoint was created from **Bertin Gaussian 512**, which is a **RoBERTa-base** model trained from scratch in Spanish. Information on this base model may be found at [its own card](https://huggingface.co/bertin-project/bertin-base-gaussian-exp-512seqlen) and at deeper detail on [the main project card](https://huggingface.co/bertin-project/bertin-roberta-base-spanish).
13
+
14
+ The training dataset for the base model is [mc4](https://huggingface.co/datasets/bertin-project/mc4-es-sampled ) subsampling documents to a total of about 50 million examples. Sampling is biased towards average perplexity values (using a Gaussian function), discarding more often documents with very large values (poor quality) of very small values (short, repetitive texts).
15
+
16
+ This is part of the
17
+ [Flax/Jax Community Week](https://discuss.huggingface.co/t/open-to-the-community-community-week-using-jax-flax-for-nlp-cv/7104), organised by [HuggingFace](https://huggingface.co/) and TPU usage sponsored by Google.
18
+
19
+
20
+ ## Team members
21
+
22
+ - Eduardo González ([edugp](https://huggingface.co/edugp))
23
+ - Javier de la Rosa ([versae](https://huggingface.co/versae))
24
+ - Manu Romero ([mrm8488](https://huggingface.co/))
25
+ - María Grandury ([mariagrandury](https://huggingface.co/))
26
+ - Pablo González de Prado ([Pablogps](https://huggingface.co/Pablogps))
27
+ - Paulo Villegas ([paulo](https://huggingface.co/paulo))