Spaces:

edugp
/

perplexity-lenses

Runtime error

App Files Files Community

perplexity-lenses / tests

1 contributor

History: 2 commits

edugp's picture

Run tokenizer before computing perplexity and format

7b62017 about 3 years ago

__init__.py

0 Bytes

Add tests and fix issue when splitting into sentences, to grab the minimum number between total sentences and sample size, rather than total original documents and sample size about 3 years ago
test_data.py

510 Bytes

Run tokenizer before computing perplexity and format about 3 years ago