Update README.md

README.md

@@ -39,7 +39,7 @@ co2_eq_emissions:
 
 ## Model Summary
 
-Given the lack of available monolingual foundational models in non-English languages and the fact that some of the most used and downloaded models by the community are those small enough to allow individual researchers and hobbyists to use them in low-resource environments, we developed the TeenyTinyLlama: _a series of small foundational models trained on Portuguese._
+Given the lack of available monolingual foundational models in non-English languages and the fact that some of the most used and downloaded models by the community are those small enough to allow individual researchers and hobbyists to use them in low-resource environments, we developed the TeenyTinyLlama: _a series of small foundational models trained in Portuguese language._
 
 TeenyTinyLlama is a compact language model based on the Llama 2 architecture ([TinyLlama implementation](https://huggingface.co/TinyLlama)). This model is designed to deliver efficient natural language processing capabilities while being resource-conscious.
 
@@ -92,7 +92,7 @@ These are the main arguments used in the training of this model:
 | adam epsilon                  | 0.00000001                           |
 | weight decay                  | 0.01                                 |
 | scheduler type                | "cosine"                             |
-| warmup steps                  | 50000                                | 
+| warmup steps                  | 5000                                 | 
 | gradient checkpointing        | false                                |
 | seed                          | 42                                   |
 | mixed precision               | 'no'                                 |