Evaluation results used for calculating perplexity.
#18
by
sentosa
- opened
I have a question, can perplexity and language probability be used for statistical analysis of Chinese documents?
I tried to calculate the perplexity of my document statistically, but the results were not quite as expected, some were less than ideal.
How to test the model。I input my own text and use a model for output