yenniejun commited on
Commit
c4e64d6
1 Parent(s): e7c169f

Updating link to blog in app

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -85,7 +85,7 @@ with st.sidebar:
85
  st.subheader('About the project')
86
  with st.expander("All languages are NOT created (tokenized) equal!"):
87
 
88
- link="The purpose of this project is to compare the tokenization length for different languages. For some tokenizers, tokenizing a message in one language may result in 10-20x more tokens than a comparable message in another language (e.g. try English vs. Burmese). This is part of a larger project of measuring inequality in NLP. See the original article: [All languages are NOT created (tokenized) equal](https://blog.yenniejun.com/p/all-languages-are-not-created-tokenized)"
89
  st.markdown(link)
90
 
91
 
 
85
  st.subheader('About the project')
86
  with st.expander("All languages are NOT created (tokenized) equal!"):
87
 
88
+ link="The purpose of this project is to compare the tokenization length for different languages. For some tokenizers, tokenizing a message in one language may result in 10-20x more tokens than a comparable message in another language (e.g. try English vs. Burmese). This is part of a larger project of measuring inequality in NLP. See the original article: [All languages are NOT created (tokenized) equal](https://www.artfish.ai/p/all-languages-are-not-created-tokenized)"
89
  st.markdown(link)
90
 
91