tinkoff-ai
/

response-quality-classifier-tiny

Text Classification

Inference Endpoints

Model card Files Files and versions Community

egoriya commited on May 31, 2022

Commit

1ff1a29

•

1 Parent(s): 8539235

Update README.md

Files changed (1) hide show

README.md +5 -5

README.md CHANGED Viewed

@@ -18,14 +18,14 @@ The labels explanation:
 The preferable length of the dialogue is 4 where the last message is needed to be estimated
-It is pretrained on corpus of dialog data from social networks and finetuned on [tinkoff-ai/context_similarity](https://huggingface.co/tinkoff-ai/context_similarity).
 The performance of the model on validation split [tinkoff-ai/context_similarity](https://huggingface.co/tinkoff-ai/context_similarity) (with the best thresholds for validation samples):
-|             |   f0.5 |   ROC AUC |
-|:------------|-------:|----------:|
-| relevance   |   0.82 |      0.74 |
-| specificity |   0.81 |      0.8  |
 The preferable usage:

 The preferable length of the dialogue is 4 where the last message is needed to be estimated
+It is pretrained on corpus of dialog data and finetuned on [tinkoff-ai/context_similarity](https://huggingface.co/tinkoff-ai/context_similarity).
 The performance of the model on validation split [tinkoff-ai/context_similarity](https://huggingface.co/tinkoff-ai/context_similarity) (with the best thresholds for validation samples):
+|             |   threshold |   f0.5 |   ROC AUC |
+|:------------|------------:|-------:|----------:|
+| relevance   |        0.51 |   0.82 |      0.74 |
+| specificity |        0.54 |   0.81 |      0.8  |
 The preferable usage: