Spaces:

yenniejun
/

tokenizers-languages

Running

App Files Files Community

tokenizers-languages / app.py

Commit History

Add barchart showing shortest/longest median tokenized text

40b05d1

Running
verified

yenniejun commited on May 14

Update app.py

111053f
verified

yenniejun commited on May 14

Update app.py

94a7df7
verified

yenniejun commited on May 14

fix tabs

cb5b76e
verified

yenniejun commited on May 14

fix tab

ba38c3f
verified

yenniejun commited on May 14

Upload 2 files

8c475b6
verified

yenniejun commited on May 14

Updating link to blog in app

c4e64d6

yenniejun commited on Sep 29, 2023

Updating the About the Project section

96bd252

Yennie Jun commited on Sep 20, 2023

Rearranging some of the figures

5943f5c

yenniejun commited on Apr 30, 2023

Rename text in button for refreshing

26e280e

yenniejun commited on Apr 28, 2023

Adding example texts to show

62551b2

yenniejun commited on Apr 28, 2023

Update explanation message and link to amazon

8641796

yenniejun commited on Apr 27, 2023

Adding explanation for project

616477f

yenniejun commited on Apr 27, 2023

Remove divider

fe5c81b

yenniejun commited on Apr 27, 2023

Update small formatting things:

c1ad373

yenniejun commited on Apr 27, 2023

Make label visibility collapsed for some options

aaff21f

yenniejun commited on Apr 27, 2023

clean up the figure, add data caching, add headers

535e678

yenniejun commited on Apr 27, 2023

update code to match updated data with pre-calculated token lens

29daff8

yenniejun commited on Apr 27, 2023

rename to app.py

87987fe

yenniejun commited on Apr 27, 2023