iapyx-v3-exaone-deep-7.8b โ€” Iapyx v3 (LG AI ์—ฐ๊ตฌ์›)

2026 AI ๋ฃจํ‚ค ๊ฒฐ์„  Team Iapyx(AI ๋ผ์ดํ”„ ๊ฐ€๋””์–ธ, ๊ตญ๋‚ด AI ํŠธ๋ž™)๊ฐ€ ๋Œ€ํšŒ ์ง€๊ธ‰ A100 80GB ร—2์—์„œ LGAI-EXAONE/EXAONE-Deep-7.8B๋ฅผ ์ „์ฒด ๊ฐ€์ค‘์น˜ ํŒŒ์ธํŠœ๋‹(FSDP) ๋ฐฉ์‹์œผ๋กœ ๊ฐ€๋ฅด์นœ ๊ฒฐ๊ณผ๋‹ค. ํŒ์ •์€ ์ œํ’ˆ์˜ ๊ฒฐ์ •์  ๊ทœ์น™์ด ๋‚ด๋ฆฌ๊ณ , ์ด ๋ชจ๋ธ์€ ์ •ํ•ด์ง„ ์นธ(JSON)ยท๋„๊ตฌ ๊ณ ๋ฅด๊ธฐยท์„œ๋ฅ˜ ์นธ ์ฝ๊ธฐยท๊ฒ€์‚ฐยทํ‘œํ˜„ ๋‹ค๋“ฌ๊ธฐ๋ฅผ ๋ฐฐ์šด๋‹ค.

๊ณผ์—… 6์ข… (๊ฐ™์€ held-out, ๊ฐ™์€ ์ฑ„์  ์ฝ”๋“œ)

์ง€ํ‘œ ๊ฐ€๋ฅด์น˜๊ธฐ ์ „ ๊ฐ€๋ฅด์นœ ๋’ค
์œ„ํ—˜ ๋“ฑ๊ธ‰ macro-F1 0.000 1.000
๋„๊ตฌ ๊ณ ๋ฅด๊ธฐ ์ •ํ™•๋„ 0.270 1.000
์„œ๋ฅ˜ ์นธ F1 0.000 0.999
๊ฒ€์‚ฐ ์™„์ „ ์ผ์น˜์œจ 0.000 0.800
ํ‘œํ˜„ ์•ˆ์ „์œจ 0.200 0.955
๋ฒ•๋ฅ  ์šฉ์–ด chrF 0.036 0.115

์ข…ํ•ฉ(5๊ณผ์—… ํ‰๊ท , domain ์ œ์™ธ): ์ „ 0.094 โ†’ ํ›„ 0.9507644287396937 ยท ํ•œ ๊ฑด ์ƒ์„ฑ ์ง€์—ฐ 0.3468s(๋ฐฐ์น˜, A100)

ํ•™์Šต ๊ตฌ์„ฑ

  • ์—ํฌํฌ 16.0 (๊ฐ€์žฅ ์ข‹์€ ์—ํฌํฌ 2.0, ํ‰๊ฐ€ ์†์‹ค 0.3615524470806122), lr 1e-05, ๋ฐฐ์น˜ 4ร—๋ˆ„์  4ร—GPU 1, ์ตœ๋Œ€ ๊ธธ์ด 2048
  • ํ•™์Šต ์‹œ๊ฐ„ 22542.5์ดˆ, ํ•™์Šต 11018๊ฑด / ํ‰๊ฐ€ 1130๊ฑด
  • ๋ฐ์ดํ„ฐ: ํ•ฉ์„ฑ SFT(์œ„ํ—˜ ํŒ์ •ยท๋„๊ตฌ ๊ณ ๋ฅด๊ธฐยท์„œ๋ฅ˜ ์ถ”์ถœยท๊ฒ€์‚ฐ)๋Š” ์ œํ’ˆ ๊ทœ์น™ ์ƒ์„ฑ๊ธฐ, ํ‘œํ˜„ ๊ณผ์—… ์ •๋‹ต์€ ๊ตญ๋‚ด API K-EXAONE(์ถ”๋ก  ๋”)์—์„œ ๋ฐ›์•„ ์ˆซ์žยท๊ธธ์ด ๊ฒ€์‚ฌ๋ฅผ ํ†ต๊ณผํ•œ ๊ฒƒ๋งŒ, ๋ฒ•๋ฅ  ์šฉ์–ด๋Š” JusWis/korean-legal-terminology(CC BY 4.0). ํ•ด์™ธ ๋ชจ๋ธ์€ ๋ฐ์ดํ„ฐยทํ•™์Šตยทํ‰๊ฐ€ ์–ด๋””์—๋„ ์“ฐ์ง€ ์•Š์•˜๋‹ค.
  • ์†์‹ค์€ assistant ํ† ํฐ์—๋งŒ. ์—ํฌํฌ๋งˆ๋‹ค ํ‰๊ฐ€ ์†์‹ค์„ ์žฌ๊ณ  ๊ฐ€์žฅ ๋‚ฎ์€ ์—ํฌํฌ๋ฅผ ๋‚จ๊ฒผ๋‹ค(๊ณผ์ ํ•ฉ ์ง€์  ํ™•์ธ์šฉ ๊ณก์„ ์€ W&B iapyx-finetune).
์—ํฌํฌ ํ‰๊ฐ€ ์†์‹ค
1 0.3685
2 0.3616
3 0.3859
4 0.4220
5 0.4573
6 0.5044
7 0.5250
8 0.5652
9 0.5919
10 0.6174
11 0.6390
12 0.6539
13 0.6598
14 0.6622
15 0.6628
16 0.6628

๋ผ์ด์„ ์Šคยท์šฉ๋„

๋ฐ”ํƒ• ๋ชจ๋ธ ๋ผ์ด์„ ์Šค: EXAONE AI Model License (์—ฐ๊ตฌ์šฉ). ๋Œ€ํšŒยท์—ฐ๊ตฌ ๋ชฉ์ ์œผ๋กœ๋งŒ ์ผ๋‹ค. 7์›”์—” ํ…œํ”Œ๋ฆฟ ๊ฒฐํ•จ 0.036 โ€” ์ตœ์‹  ๋ฆฌ๋น„์ „์œผ๋กœ ์žฌ์‹œ๋„

์žฌํ˜„: https://github.com/AIROOKIE-S/iapyx finetune-v3/ ยท ํ‰๊ฐ€ ์›๋ณธ https://huggingface.co/datasets/space1637/iapyx-finetune-report (v3/)

Downloads last month
14
Safetensors
Model size
8B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for space1637/iapyx-v3-exaone-deep-7.8b

Finetuned
(23)
this model