2ira
/

Byte-lingua-code

Model card Files Files and versions

Byte-lingua-code / superbpe /tokenizers_superbpe /docs /source /installation /node.inc

2ira's picture

offline_compression_graph_code

72c0672 verified 4 months ago

history blame contribute delete

208 Bytes

	Installation with npm
	----------------------------------------------------------------------------------------------------

	You can simply install 🤗 Tokenizers with npm using::

	npm install tokenizers