Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Spaces:
edugp
/
perplexity-lenses
Runtime error

App Files Files Community
1
perplexity-lenses / tests
  • 1 contributor
History: 2 commits
edugp's picture
edugp
Run tokenizer before computing perplexity and format
7b62017 about 3 years ago
  • __init__.py
    0 Bytes
    Add tests and fix issue when splitting into sentences, to grab the minimum number between total sentences and sample size, rather than total original documents and sample size about 3 years ago
  • test_data.py
    510 Bytes
    Run tokenizer before computing perplexity and format about 3 years ago