distinct
Browse files- distinct.py +3 -3
distinct.py
CHANGED
@@ -48,14 +48,14 @@ _CITATION = """\
|
|
48 |
doi = "10.18653/v1/N16-1014",
|
49 |
}
|
50 |
"""
|
51 |
-
|
52 |
|
53 |
_DESCRIPTION = """\
|
54 |
Distinct metric is to calculate corpus-level diversity of language. We provide two versions of distinct score. Expectation-Adjusted-Distinct (EAD) is the default one, which removes
|
55 |
the biases of the original distinct score on lengthier sentences. Distinct is the original version.
|
56 |
|
57 |
-
|
58 |
-
<img src="https://huggingface.co/spaces/lsy641/distinct/resolve/main/distinct_compare_pic.jpg" alt="drawing" width="
|
59 |
img[alt=drawing]{}
|
60 |
|
61 |
For the use of Expectation-Adjusted-Distinct, vocab_size is required.
|
|
|
48 |
doi = "10.18653/v1/N16-1014",
|
49 |
}
|
50 |
"""
|
51 |
+
# ![Comparison between original distinct and and EAD ](https://huggingface.co/spaces/lsy641/distinct/resolve/main/distinct_compare_pic.jpg)
|
52 |
|
53 |
_DESCRIPTION = """\
|
54 |
Distinct metric is to calculate corpus-level diversity of language. We provide two versions of distinct score. Expectation-Adjusted-Distinct (EAD) is the default one, which removes
|
55 |
the biases of the original distinct score on lengthier sentences. Distinct is the original version.
|
56 |
|
57 |
+
|
58 |
+
<img src="https://huggingface.co/spaces/lsy641/distinct/resolve/main/distinct_compare_pic.jpg" alt="drawing" width="200"/>
|
59 |
img[alt=drawing]{}
|
60 |
|
61 |
For the use of Expectation-Adjusted-Distinct, vocab_size is required.
|