Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,7 @@
|
|
7 |
## ์ํคํ
์ฒ
|
8 |
- **๋ชจ๋ธ ์ ํ**: RoBERTa
|
9 |
- **์ํคํ
์ฒ**: RobertaForMaskedLM
|
10 |
-
- **๋ชจ๋ธ ํฌ๊ธฐ**:
|
11 |
- **max_position_embeddings**: 514
|
12 |
- **intermediate_size**: 2048
|
13 |
- **vocab_size**: 1428
|
|
|
7 |
## ์ํคํ
์ฒ
|
8 |
- **๋ชจ๋ธ ์ ํ**: RoBERTa
|
9 |
- **์ํคํ
์ฒ**: RobertaForMaskedLM
|
10 |
+
- **๋ชจ๋ธ ํฌ๊ธฐ**: 512 hidden size, 8 hidden layers, 8 attention heads
|
11 |
- **max_position_embeddings**: 514
|
12 |
- **intermediate_size**: 2048
|
13 |
- **vocab_size**: 1428
|