solemn-leader commited on
Commit
82d40f9
1 Parent(s): d4a38f8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -16,9 +16,9 @@ This generation model is based on [sberbank-ai/rugpt3small_based_on_gpt2](https:
16
  The model was trained with context size 3
17
 
18
 
19
- On a validation set we calculated metrics introduced in [this paper](https://arxiv.org/pdf/2001.09977.pdf):
20
- - Sensibleness: Operators are asked whether model's response makes sense given the context
21
- - Specificity: Operators are asked whether model's response is specific for given context, in other words we don't want our model to give general and boring responses
22
  - SSA which is the average of two metrics above (Sensibleness Specificity Average)
23
 
24
  | | sensibleness | specificity | SSA |
 
16
  The model was trained with context size 3
17
 
18
 
19
+ On a private validation set we calculated metrics introduced in [this paper](https://arxiv.org/pdf/2001.09977.pdf):
20
+ - Sensibleness: Crowdsourcers were asked whether model's response makes sense given the context
21
+ - Specificity: Crowdsourcers were asked whether model's response is specific for given context, in other words we don't want our model to give general and boring responses
22
  - SSA which is the average of two metrics above (Sensibleness Specificity Average)
23
 
24
  | | sensibleness | specificity | SSA |