rasyosef commited on
Commit
71b69fe
·
verified ·
1 Parent(s): 4bdb52c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -24
README.md CHANGED
@@ -61,29 +61,18 @@ You can use this model directly with a pipeline for masked language modeling:
61
  This model was finetuned and evaluated on the following amharic nlp tasks
62
 
63
  - Sentiment Classification
64
- - Named Entity Recognition
 
 
65
 
66
- ### Sentiment Classification
67
- The model was finetuned on the [amharic-sentiment](https://huggingface.co/datasets/rasyosef/amharic-sentiment)
68
- dataset to classify the given text as having `positive` or `negative` sentiment
69
 
70
- |Model|Size (# params)| Accuracy | Precision | Recall | F1 |
71
- | --- | ------------- | -------- | --------- | ------ | -- |
72
- |bert-medium-amharic|40.5M|0.83|0.83|0.82|0.83|
73
- |bert-small-amharic|27.8M|0.83|0.83|0.82|0.83|
74
- |bert-mini-amharic|10.7M|0.81|0.81|0.81|0.81|
75
- |bert-tiny-amharic|4.18M|0.79|0.79|0.79|0.79|
76
- |xlm-roberta-base|279M|0.83|0.83|0.83|0.83|
77
- |am-roberta|443M|0.82|0.83|0.82|0.82|
78
-
79
- ### Named Entity Recognition
80
- The model was finetuned on the [amharic-named-entity-recognition](https://huggingface.co/datasets/rasyosef/amharic-named-entity-recognition) dataset.
81
-
82
- |Model|Size (# params)| Precision | Recall | F1 |
83
- | --- | ------------- | --------- |------- | -- |
84
- |bert-medium-amharic|40.5M|0.64|0.73|0.68|
85
- |bert-small-amharic|27.8M|0.64|0.72|0.68|
86
- |bert-mini-amharic|10.7M|0.60|0.67|0.64|
87
- |bert-tiny-amharic|4.18M|0.50|0.59|0.54|
88
- |xlm-roberta-base|279M|0.69|0.79|0.73|
89
- |am-roberta|443M|0.67|0.72|0.69|
 
61
  This model was finetuned and evaluated on the following amharic nlp tasks
62
 
63
  - Sentiment Classification
64
+ - Dataset: [amharic-sentiment](https://huggingface.co/datasets/rasyosef/amharic-sentiment)
65
+ - Named Entity Recognition
66
+ - Dataset: [amharic-named-entity-recognition](https://huggingface.co/datasets/rasyosef/amharic-named-entity-recognition)
67
 
68
+ ### Finetuned Model Performance
69
+ The reported F1 scores are macro averages.
 
70
 
71
+ |Model|Size (# params)| Perplexity|Sentiment (F1)| Named Entity Recognition (F1)|
72
+ |-----|---------------|-----------|--------------|------------------------------|
73
+ |**bert-medium-amharic**|**40.5M**|**13.74**|**0.83**|**0.68**|
74
+ |bert-small-amharic|27.8M|15.96|0.83|0.68|
75
+ |bert-mini-amharic|10.7M|22.42|0.81|0.64|
76
+ |bert-tiny-amharic|4.18M|71.52|0.79|0.54|
77
+ |xlm-roberta-base|279M||0.83|0.73|
78
+ |am-roberta|443M||0.82|0.69|