AIFT-42dot-LLM-PLM-1.3B-instruct-slim-v1.5

베이스 모델 : 42dot/42dot_LLM-PLM-1.3B

학습 데이터 : 자체 제작한 instruction 데이터셋 약 60,000건

학습 방법 : Lora

Lora Config

• lora_alpha: 16
• lora_dropout: 0.05,
• r: 8

ko-lm-evaluation-harness(0-shot)

kobest_boolq	kobest_copa	kobest_hellaswag	kobest_sentineg	kohatespeech	kohatespeech_apeach	kohatespeech_gen_bias	korunsmile	nsmc	pawsx_ko
0.4843304843304843	0.688	0.444	0.7229219143576826	0.3057324840764331	0.4586206896551724	0.40764331210191085	0.3758328354743747	0.66632	0.5445