aeolian83 commited on
Commit
637265b
1 Parent(s): 88daba2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -2
README.md CHANGED
@@ -2,5 +2,23 @@
2
  license: apache-2.0
3
  language:
4
  - ko
5
- - en
6
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: apache-2.0
3
  language:
4
  - ko
5
+ datasets:
6
+ - squarelike/sharegpt_deepl_ko_translation
7
+ tags:
8
+ - pytorch
9
+ - causal-lm
10
+ ---
11
+
12
+ # poly-ko-1.3b-translate
13
+
14
+ - EleutherAI/polyglot-ko-1.3b을 squarelike/sharegpt_deepl_ko_translation으로 영한 번역만 가능하도록 fine-tuning한 모델
15
+ - QRoLA기법으로 fine-tunnig
16
+
17
+ ### 훈련 정보
18
+ - Epoch: 3
19
+ - learning-rate: 3e-4
20
+ - batch_size: 1
21
+ - Lora r: 8
22
+ - Lora target modules: query_key_value
23
+
24
+ 3090GPU 1대로 훈련했습니다.