blueapple8259 commited on
Commit
1e9afa7
โ€ข
1 Parent(s): d632ac1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -9,3 +9,15 @@ language:
9
  [TinyKo-v5-b](https://huggingface.co/blueapple8259/TinyKo-v5-b)๋ชจ๋ธ์„ [kullm-v2](https://huggingface.co/datasets/nlpai-lab/kullm-v2)๋ฐ์ดํ„ฐ์…‹์œผ๋กœ ํŒŒ์ธํŠœ๋‹ํ•œ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.
10
 
11
  ์ฃผ์˜: ์„ฑ๋Šฅ์ด ๋งค์šฐ ๋–จ์–ด์ง€๋ฉฐ ํ• ๋ฃจ์‹œ๋„ค์ด์…˜์ด ๋งค์šฐ ์‹ฌํ•ฉ๋‹ˆ๋‹ค.
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  [TinyKo-v5-b](https://huggingface.co/blueapple8259/TinyKo-v5-b)๋ชจ๋ธ์„ [kullm-v2](https://huggingface.co/datasets/nlpai-lab/kullm-v2)๋ฐ์ดํ„ฐ์…‹์œผ๋กœ ํŒŒ์ธํŠœ๋‹ํ•œ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.
10
 
11
  ์ฃผ์˜: ์„ฑ๋Šฅ์ด ๋งค์šฐ ๋–จ์–ด์ง€๋ฉฐ ํ• ๋ฃจ์‹œ๋„ค์ด์…˜์ด ๋งค์šฐ ์‹ฌํ•ฉ๋‹ˆ๋‹ค.
12
+
13
+ ## ๋ชจ๋ธ ์ •๋ณด
14
+
15
+ model type: llama
16
+
17
+ hidden size: 6
18
+
19
+ hidden size: 127
20
+
21
+ num attention heads: 16
22
+
23
+ num key value heads: 4