jb723 commited on
Commit
86e59e8
โ€ข
1 Parent(s): 1cd1ad1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -2
README.md CHANGED
@@ -3,6 +3,9 @@ license: mit
3
  ---
4
 
5
  ํ•™์Šต ๋ฐ์ดํ„ฐ
6
- Kullmv2 dataset, alpaca instruction dataset, AIhub ํ•œ๊ตญ์–ด-์˜์–ด ๋ณ‘๋ ฌ ๋ฐ์ดํ„ฐ์…‹, dolly ๋ฐ์ดํ„ฐ์…‹, share GPT ๋ฐ์ดํ„ฐ์…‹
7
  ์„ ํ™œ์šฉํ•˜์—ฌ ์‚ฌ์šฉ
8
- ํ•œ๊ตญ์–ด ์˜์–ด ๋ณ‘๋ ฌ ๋ฐ์ดํ„ฐ์˜ ๊ฒฝ์šฐ ๋ฒˆ์—ญ์„ ํ•ด๋‹ฌ๋ผ๋Š” ์ง€์‹œ๋ฌธ์˜ ํ˜•ํƒœ๋กœ ๋ณ€ํ™˜ํ›„ instruction tuning
 
 
 
 
3
  ---
4
 
5
  ํ•™์Šต ๋ฐ์ดํ„ฐ
6
+ Kullmv2 dataset, alpaca instruction dataset, dolly ๋ฐ์ดํ„ฐ์…‹, share GPT ๋ฐ์ดํ„ฐ์…‹ , AIhub ํ•œ๊ตญ์–ด-์˜์–ด ๋ณ‘๋ ฌ ๋ฐ์ดํ„ฐ์…‹
7
  ์„ ํ™œ์šฉํ•˜์—ฌ ์‚ฌ์šฉ
8
+ ํ•œ๊ตญ์–ด ์˜์–ด ๋ณ‘๋ ฌ ๋ฐ์ดํ„ฐ์˜ ๊ฒฝ์šฐ ๋ฒˆ์—ญ์„ ํ•ด๋‹ฌ๋ผ๋Š” ์ง€์‹œ๋ฌธ์˜ ํ˜•ํƒœ๋กœ ๋ณ€ํ™˜ํ›„ instruction tuning
9
+
10
+ tokenizer์˜ ๊ฒฝ์šฐ beomi๋‹˜์˜ llama2 tokenizer๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ํ•™์Šต์„ ์ง„ํ–‰ํ•˜์˜€์œผ๋ฉฐ,
11
+ ๋ชจ๋ธ์˜ ์ดˆ๊ธฐ parameter์˜ ๊ฒฝ์šฐ meta์˜ llama2-7b-hf๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ํ•™์Šต์„ ์ง„ํ–‰