orai-nlp
/

ElhBERTeu

Feature Extraction

Inference Endpoints

text-embeddings-inference

Model card Files Files and versions Community

Gorka Urbizu Garmendia commited on May 6, 2022

Commit

d5a5078

•

1 Parent(s): a1b8ea8

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -30,8 +30,8 @@ The model has been evaluated on the recently created BasqueGLUE NLU benchmark:
 | Model     |  AVG      |  NERC     |  F_intent | F_slot  |  BHTC   |  BEC    |  Vaxx   |  QNLI   |  WiC    | coref   |
 |-----------|:---------:|:---------:|:---------:|:-------:|:-------:|:-------:|:-------:|:-------:|:-------:|:-------:|
 |           |           |   F1      |    F1     |   F1    |   F1    |   F1    |  MF1    |  acc    |  acc    |  acc    |
-| BERTeus   | 73.23     | 81.92     | **82.52** |  74.34  |**78.26**| 69.43   | 59.30   |**74.26**| 70.71   |**68.31**|
-| ElhBERTeu | **73.71** | **82.30** |   82.24   |**75.64**| 78.05   |**69.89**|**63.81**| 73.84   |**71.71**| 65.93   |
 If you use this model, please cite the following paper:

 | Model     |  AVG      |  NERC     |  F_intent | F_slot  |  BHTC   |  BEC    |  Vaxx   |  QNLI   |  WiC    | coref   |
 |-----------|:---------:|:---------:|:---------:|:-------:|:-------:|:-------:|:-------:|:-------:|:-------:|:-------:|
 |           |           |   F1      |    F1     |   F1    |   F1    |   F1    |  MF1    |  acc    |  acc    |  acc    |
+| BERTeus   |   73.23   |   81.92   | **82.52** |  74.34  |**78.26**|  69.43  |  59.30  |**74.26**|  70.71  |**68.31**|
+| ElhBERTeu | **73.71** | **82.30** |   82.24   |**75.64**|  78.05  |**69.89**|**63.81**|  73.84  |**71.71**|  65.93  |
 If you use this model, please cite the following paper: