lvwerra HF staff commited on
Commit
c4de5d6
1 Parent(s): 1443daa

Update Space (evaluate main: 05209ece)

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -10,6 +10,11 @@ pinned: false
10
  tags:
11
  - evaluate
12
  - measurement
 
 
 
 
 
13
  ---
14
 
15
  # Measurement Card for Perplexity
 
10
  tags:
11
  - evaluate
12
  - measurement
13
+ description: >-
14
+ Perplexity (PPL) can be used for evaluating to what extent a dataset is similar to the distribution of text that a given model was trained on.
15
+ It is defined as the exponentiated average negative log-likelihood of a sequence.
16
+
17
+ For more information, see https://huggingface.co/docs/transformers/perplexity
18
  ---
19
 
20
  # Measurement Card for Perplexity