Spaces:

eson
/

tokenizer-arena

Running

App Files Files Community

tokenizer-arena / requirements.txt

eson's picture

update

7c73423 about 1 month ago

No virus

132 Bytes

	gradio>=4.32.0
	transformers
	sentencepiece
	tiktoken
	icetk
	torch
	nltk
	boto3
	protobuf==4.25.3
	ai2-olmo==0.2.4
	ipadic
	fugashi