IlyaGusev commited on
Commit
ad08461
1 Parent(s): 95876e3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -0
README.md CHANGED
@@ -10,6 +10,17 @@ pipeline_tag: conversational
10
 
11
  Colab: [link](https://colab.research.google.com/drive/1IBh4FMJPOGZAkX7DYWnIKdav_ZcKatlP)
12
 
 
 
 
 
 
 
 
 
 
 
 
13
  v1:
14
  - revision 1ad1cb364e3e245a7a376884111e107cfc013911
15
  - wandb [link](https://wandb.ai/ilyagusev/rulm_self_instruct/runs/kx2uytey/overview)
 
10
 
11
  Colab: [link](https://colab.research.google.com/drive/1IBh4FMJPOGZAkX7DYWnIKdav_ZcKatlP)
12
 
13
+ v2:
14
+ - revision 95876e3d9854e937104f623a5fb7144ca990e8ba
15
+ - wandb [link](https://wandb.ai/ilyagusev/rulm_self_instruct/runs/8p3nfjqv/overview)
16
+ - 4 datasets: ru_turbo_alpaca, ru_turbo_saiga, ru_sharegpt_cleaned, oasst1_ru_main_branch
17
+ - Datasets merging script: [create_chat_set.py](https://github.com/IlyaGusev/rulm/blob/ef58f3d82d6e7b3784d42167ff69188d3766ab61/self_instruct/src/data_processing/create_chat_set.py)
18
+ - Loss: 0.942
19
+ - Context length: 2000
20
+ - Conversational template: `"<s>{role}\n{content}</s>"`
21
+ - Possible roles: `["system", "user", "bot"]`
22
+ - System prompt: `"Ты — Сайга, русскоязычный автоматический ассистент. Ты разговариваешь с людьми и помогаешь им."`
23
+
24
  v1:
25
  - revision 1ad1cb364e3e245a7a376884111e107cfc013911
26
  - wandb [link](https://wandb.ai/ilyagusev/rulm_self_instruct/runs/kx2uytey/overview)