IlyaGusev
/

saiga_30b_lora

Text Generation

Model card Files Files and versions Community

IlyaGusev commited on Apr 20, 2023

Commit

8573592

•

1 Parent(s): 1be47ea

Update model

Files changed (2) hide show

README.md +2 -2
adapter_model.bin +1 -1

README.md CHANGED Viewed

@@ -138,8 +138,8 @@ v1:
 - wandb [link](https://wandb.ai/ilyagusev/rulm_self_instruct/runs/x2c19kfk)
 - 4 datasets: ru_turbo_alpaca, ru_turbo_saiga, ru_sharegpt_cleaned, oasst1_ru_main_branch
 - Datasets merging script: [create_chat_set.py](https://github.com/IlyaGusev/rulm/blob/ef58f3d82d6e7b3784d42167ff69188d3766ab61/self_instruct/src/data_processing/create_chat_set.py)
-- Loss: 0.822
 - Context length: 2000
 - Conversational template: `"<s>{role}\n{content}</s>"`
 - Possible roles: `["system", "user", "bot"]`
-- System prompt: `"Ты — Сайга, русскоязычный автоматический ассистент. Ты разговарив

 - wandb [link](https://wandb.ai/ilyagusev/rulm_self_instruct/runs/x2c19kfk)
 - 4 datasets: ru_turbo_alpaca, ru_turbo_saiga, ru_sharegpt_cleaned, oasst1_ru_main_branch
 - Datasets merging script: [create_chat_set.py](https://github.com/IlyaGusev/rulm/blob/ef58f3d82d6e7b3784d42167ff69188d3766ab61/self_instruct/src/data_processing/create_chat_set.py)
+- Loss: 0.817
 - Context length: 2000
 - Conversational template: `"<s>{role}\n{content}</s>"`
 - Possible roles: `["system", "user", "bot"]`
+- System prompt: `"Ты — Сайга, русскоязычный автоматический ассистент. Ты разговарив

adapter_model.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9efdee038d78af46f77465a09f2c97fb3d7d3fb86582140567fa7a8a1b38a858
 size 204646285

 version https://git-lfs.github.com/spec/v1
+oid sha256:0db1d379523696927445a5b60fd22ca0329d91f297cd86c08a882d2c84014939
 size 204646285