MinistryofDigitalAffairs commited on
Commit
9e4d1b4
·
verified ·
1 Parent(s): 1dc9bf7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -29,6 +29,8 @@ PLLuM is a family of large language models (LLMs) specialized in Polish and othe
29
 
30
  Below is a summary of the main PLLuM models, including their licenses, bases, and parameter sizes. All model names link to a specific Hugging Face resources, while the base models and licenses link to their respective sources or license references. Note that all *-nc-* models are intended to non-commercial use.
31
 
 
 
32
  | Model Name | Params | License | Based On |
33
  |-------------------------------------------------------|----------------------|---------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------|
34
  | [Llama-PLLuM-8B-base](https://huggingface.co/CYFRAGOVPL/Llama-PLLuM-8B-base) | 8B | [Llama 3.1](https://huggingface.co/meta-llama/Llama-3.1-8B/blob/main/LICENSE) | [Llama3.1-8B](https://huggingface.co/meta-llama/Llama-3.1-8B) |
 
29
 
30
  Below is a summary of the main PLLuM models, including their licenses, bases, and parameter sizes. All model names link to a specific Hugging Face resources, while the base models and licenses link to their respective sources or license references. Note that all *-nc-* models are intended to non-commercial use.
31
 
32
+ The models with fully open licenses are continuously pretrained on approximately 30 billion tokens of Polish text due to copyright considerations. The models with CC-BY-NC-4.0 licenses used approximately 150 billion tokens of Polish text. The models with the -nc and -chat suffix were aligned on human preferences and are generally safer and more efficient to use in dialog, general purpose scenarios.
33
+
34
  | Model Name | Params | License | Based On |
35
  |-------------------------------------------------------|----------------------|---------------------------------------------------------------------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------|
36
  | [Llama-PLLuM-8B-base](https://huggingface.co/CYFRAGOVPL/Llama-PLLuM-8B-base) | 8B | [Llama 3.1](https://huggingface.co/meta-llama/Llama-3.1-8B/blob/main/LICENSE) | [Llama3.1-8B](https://huggingface.co/meta-llama/Llama-3.1-8B) |