Update README.md

README.md

@@ -28,6 +28,7 @@ SambaLingo-Hungarian-Base is a pretrained Bi-lingual Hungarian and English model
 - **Language(s):** Hungarian, English
 - **Finetuned from model:** [Llama 2](https://huggingface.co/meta-llama/Llama-2-7b-hf)
 - **Try the chat version of this model**: [SambaLingo-chat-space](https://huggingface.co/spaces/sambanovasystems/SambaLingo-chat-space).
+- **Paper:** [SambaLingo: Teaching Large Language Models New Languages](https://arxiv.org/abs/2404.05829)
 - **Blog Post**: [sambalingo-open-source-language-experts](https://sambanova.ai/blog/sambalingo-open-source-language-experts)
 
 ## Getting Started
@@ -53,15 +54,7 @@ All pre-training is done on the [Cultura-X](https://huggingface.co/datasets/uonl
 We extended the vocabulary of the base llama model from 32,000 tokens to 57,000 tokens by adding up to 25,000 non-overlapping tokens from the new language.
 
 ## Evaluation
-|        | SambaLingo-Hungarian-Base    | PULI-GPTrio | bloom-7b1 | xglm-7.5B | mGPT-13B |        
-|------------------------------|-------------|-----------|-----------|----------|--------|
-| Perplexity (Lower Is Better) | **1.614**       | 1.720     | 3.284     | 3.687    | 2.488  |
-| FLORES en->hu (8 shot, CHRF) | **0.496**       | 0.422     | 0.113     | 0.019    | 0.200  |
-| FLORES hu->en (8 shot, CHRF) | **0.558**       | 0.459     | 0.162     | 0.146    | 0.174  |
-| FLORES en->hu (8 shot, BLEU) | **0.164**       | 0.098     | 0.002     | 0.001    | 0.010  |
-| FLORES hu->en (8 shot, BLEU) | **0.261**       | 0.154     | 0.004     | 0.004    | 0.009  |
-| Belebele (3 shot)            | **41.78%**      | 27.67%    | 26.78%    | 24.00%   | 24.56% |
-| SIB-200 (3 shot)             | **57.35%**      | 51.96%    | 35.78%    | 41.18%   | 41.18% |
+For evaluation results see our paper: [SambaLingo: Teaching Large Language Models New Languages](https://arxiv.org/abs/2404.05829)
 
 
 ## Uses
@@ -103,12 +96,12 @@ We would like to give a special thanks to the following groups:
 
 ## Cite SambaLingo
 ```
-@software{sambalingo,
-  title = {{SambaLingo: Open Source Language Experts}},
-  author = {SambaNova Systems},
-  url = {https://huggingface.co/sambanovasystems/SambaLingo-Hungarian-Base}
-  month = {2},
-  year = {2024},
-  version = {1.0},
+@misc{csaki2024sambalingo,
+      title={SambaLingo: Teaching Large Language Models New Languages}, 
+      author={Zoltan Csaki and Bo Li and Jonathan Li and Qiantong Xu and Pian Pawakapan and Leon Zhang and Yun Du and Hengyu Zhao and Changran Hu and Urmish Thakker},
+      year={2024},
+      eprint={2404.05829},
+      archivePrefix={arXiv},
+      primaryClass={cs.CL}
 }
 ```