Spaces:

lsy641
/

distinct

Runtime error

lsy641 commited on Jul 7, 2023

Commit

6e74774

•

1 Parent(s): dac5108

update README

Files changed (1) hide show

distinct.py CHANGED Viewed

@@ -51,9 +51,11 @@ _CITATION = """\
 _DESCRIPTION = """\
-Distinct metric is to calculate corpus-level diversity of language. We provide two versions of distinct score. Expectation-Adjusted-Distinct is the default one, which removes
 the biases of the original distinct score on lengthier sentences. Distinct is the original version.
 For the use of Expectation-Adjusted-Distinct, vocab_size is required.
 Please follow ACL paper https://aclanthology.org/2022.acl-short.86 for motivation and follow the rules of thumb provided by https://github.com/lsy641/Expectation-Adjusted-Distinct/blob/main/EAD.ipynb to determine the vocab_size

 _DESCRIPTION = """\
+Distinct metric is to calculate corpus-level diversity of language. We provide two versions of distinct score. Expectation-Adjusted-Distinct (EAD) is the default one, which removes
 the biases of the original distinct score on lengthier sentences. Distinct is the original version.
+![Comparison between original distinct and and EAD ](https://huggingface.co/spaces/lsy641/distinct/blob/main/distinct%20compare%20pic.jpg)
 For the use of Expectation-Adjusted-Distinct, vocab_size is required.
 Please follow ACL paper https://aclanthology.org/2022.acl-short.86 for motivation and follow the rules of thumb provided by https://github.com/lsy641/Expectation-Adjusted-Distinct/blob/main/EAD.ipynb to determine the vocab_size