nicholasKluge commited on
Commit
8a68654
1 Parent(s): 550157b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -41,9 +41,9 @@ co2_eq_emissions:
41
 
42
  Given the lack of available monolingual foundational models in non-English languages and the fact that some of the most used and downloaded models by the community are those small enough to allow individual researchers and hobbyists to use them in low-resource environments, we developed the TeenyTinyLlama: _a series of small foundational models trained in Portuguese language._
43
 
44
- TeenyTinyLlama is a compact language model based on the Llama 2 architecture ([TinyLlama implementation](https://huggingface.co/TinyLlama)). This model is designed to deliver efficient natural language processing capabilities while being resource-conscious.
45
 
46
- Also, these models were trained by leveraging [scaling laws](https://arxiv.org/abs/2203.15556) to determine the optimal number of tokens per parameter while incorporating [preference pre-training](https://arxiv.org/abs/2112.00861).
47
 
48
  ## Details
49
 
 
41
 
42
  Given the lack of available monolingual foundational models in non-English languages and the fact that some of the most used and downloaded models by the community are those small enough to allow individual researchers and hobbyists to use them in low-resource environments, we developed the TeenyTinyLlama: _a series of small foundational models trained in Portuguese language._
43
 
44
+ TeenyTinyLlama is a series of compact language models based on the Llama 2 architecture ([TinyLlama implementation](https://huggingface.co/TinyLlama)). These models are designed to deliver efficient natural language processing capabilities while being resource-conscious.
45
 
46
+ Also, TeenyTinyLlama models were trained by leveraging [scaling laws](https://arxiv.org/abs/2203.15556) to determine the optimal number of tokens per parameter while incorporating [preference pre-training](https://arxiv.org/abs/2112.00861).
47
 
48
  ## Details
49