Spaces:

xu-song
/

tokenizer-arena

Running

App Files Files Community

tokenizer-arena / requirements.txt

xu-song's picture

update

1ee0570 about 1 year ago

55 Bytes

	transformers>=4.21.1
	sentencepiece
	tiktoken
	icetk
	torch