mrm8488 commited on
Commit
44300af
1 Parent(s): be76685

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -0
README.md ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: es
3
+ license: mit
4
+ ---
5
+
6
+
7
+
8
+ # ConvBERT small pre-trained on large_spanish_corpus
9
+
10
+ ## Metrics on evaluation set
11
+
12
+ ```
13
+ disc_accuracy = 0.95163906
14
+ disc_auc = 0.9405496
15
+ disc_loss = 0.13658184
16
+ disc_precision = 0.80829453
17
+ disc_recall = 0.49316448
18
+ global_step = 1000000
19
+ loss = 9.12079
20
+ masked_lm_accuracy = 0.53505784
21
+ masked_lm_loss = 2.3028736
22
+ sampled_masked_lm_accuracy = 0.44047198
23
+ ```
24
+
25
+ ## Usage
26
+
27
+ ```python
28
+ from transformers import AutoModel, AutoTokenizer
29
+ model_name = "mrm8488/convbert-small-spanish"
30
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
31
+ model = AutoModel.from_pretrained(model_name)
32
+ ```