Update README.md

README.md

@@ -29,6 +29,7 @@ SambaLingo-Thai-Base is a pretrained Bi-lingual Thai and English model that adap
 - **Language(s):** Thai, English
 - **Finetuned from model:** [Llama 2](https://huggingface.co/meta-llama/Llama-2-7b-hf)
 - **Try the chat version of this model**: [SambaLingo-chat-space](https://huggingface.co/spaces/sambanovasystems/SambaLingo-chat-space).
+- **Paper:** [SambaLingo: Teaching Large Language Models New Languages](https://arxiv.org/abs/2404.05829)
 - **Blog Post**: [sambalingo-open-source-language-experts](https://sambanova.ai/blog/sambalingo-open-source-language-experts)
 
 ## Getting Started
@@ -54,18 +55,7 @@ All pre-training is done on the [Cultura-X](https://huggingface.co/datasets/uonl
 We extended the vocabulary of the base llama model from 32,000 tokens to 57,000 tokens by adding up to 25,000 non-overlapping tokens from the new language.
 
 ## Evaluation
-
-| | SambaLingo-Thai-Base         | typhoon-7b | bloom-7b1 | xglm-7.5B | mGPT-13B |
-|------------------------------|------------|-----------|-----------|----------|--------|
-| Perplexity (Lower Is Better) | **1.288**      | 1.373     | 1.834     | 1.394    | 1.966  |
-| FLORES en->th (8 shot, CHRF) | **0.433**      | 0.347     | 0.095     | 0.198    | 0.032  |
-| FLORES th->en (8 shot, CHRF) | **0.536**      | 0.465     | 0.138     | 0.431    | 0.016  |
-| FLORES en->th (8 shot, BLEU) | **0.019**      | 0.004     | 0.000     | 0.003    | 0.000  |
-| FLORES th->en (8 shot, BLEU) | **0.247**      | 0.188     | 0.003     | 0.147    | 0.000  |
-| Belebele (3 shot)            | 37.11%     | **52.22%**    | 24.11%    | 22.44%   | 26.89% |
-| SIB-200 (3 shot)             | 62.25%     | **75.49%**    | 23.04%    | 63.73%   | 44.12% |
-| XCOPA (0 shot)               | **61.40%**     | 60.60%    | 55.40%    | 59.40%   | 52.80% |
-| XNLI (0 shot)                | **44.65%**     | 43.01%    | 34.87%    | 43.73%   | 39.24% |
+For evaluation results see our paper: [SambaLingo: Teaching Large Language Models New Languages](https://arxiv.org/abs/2404.05829)
 
 ## Uses
 <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
@@ -109,12 +99,12 @@ We would like to give a special thanks to the following groups:
 
 ## Cite SambaLingo
 ```
-@software{sambalingo,
-  title = {{SambaLingo: Open Source Language Experts}},
-  author = {SambaNova Systems},
-  url = {https://huggingface.co/sambanovasystems/SambaLingo-Thai-Base}
-  month = {2},
-  year = {2024},
-  version = {1.0},
+@misc{csaki2024sambalingo,
+      title={SambaLingo: Teaching Large Language Models New Languages}, 
+      author={Zoltan Csaki and Bo Li and Jonathan Li and Qiantong Xu and Pian Pawakapan and Leon Zhang and Yun Du and Hengyu Zhao and Changran Hu and Urmish Thakker},
+      year={2024},
+      eprint={2404.05829},
+      archivePrefix={arXiv},
+      primaryClass={cs.CL}
 }
 ```