sn92-ra-9b-a

Bittensor SN92(REAX) ์ŠคํŽ˜์…œ๋ฆฌ์ŠคํŠธ ํŠธ๋ž™ risk_assessment์šฉ์œผ๋กœ ๋ฏธ์„ธ์กฐ์ •ํ•œ Qwen3.5-9B text-only ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค. ์‹คํ—˜ ๊ฒฐ๊ณผ๋ฅผ ๊ณต์œ ํ•˜๊ธฐ ์œ„ํ•œ ์ €์žฅ์†Œ์ด๊ณ , ์ฒด์ธ์— ์ œ์ถœํ•œ ๋ชจ๋ธ์ด ์•„๋‹™๋‹ˆ๋‹ค(reax-specialist.json ๋งค๋‹ˆํŽ˜์ŠคํŠธ ์—†์Œ).

๊ธฐ๋ฐ˜ ๋ชจ๋ธ

  • Qwen/Qwen3.5-9B@c202236235762e1c871ad0ccb60c8ee5ba337b9a (Apache-2.0)
  • ๋น„์ „ ํƒ€์›Œ์™€ MTP๋ฅผ ๋บ€ text-only Qwen3_5ForCausalLM (8,953,803,264 ํŒŒ๋ผ๋ฏธํ„ฐ, ํ…์„œ ์ด๋ฆ„์€ ์›๋ณธ์˜ model.language_model.*, lm_head ๊ทธ๋Œ€๋กœ)

ํ•™์Šต

  • ๋ฐฉ์‹: ์ „์ฒด ๋ฏธ์„ธ์กฐ์ •์ž…๋‹ˆ๋‹ค. ์ž…๋ ฅ ์ž„๋ฒ ๋”ฉ๊ณผ lm_head๋Š” ๊ณ ์ •ํ–ˆ์Šต๋‹ˆ๋‹ค.
  • ์†์‹ค: ๊ฒ€์ฆ์ž ํŒ๋…๊ณผ ๊ฐ™์€ ํ˜•์‹์ž…๋‹ˆ๋‹ค. ๊ณ ์ • Qwen ํ…œํ”Œ๋ฆฟ์— ๋นˆ think ๋ธ”๋ก์„ ๋ถ™์ด๊ณ , ์ฒซ ์ƒ์„ฑ ์œ„์น˜์˜ ์„ ํƒ์ง€ ๊ธ€์ž logit์„ T=2 softmax๋กœ ๋ฐ”๊พผ ๋’ค ๋ชฉํ‘œ ๋ถ„ํฌ์™€ ๊ต์ฐจ ์—”ํŠธ๋กœํ”ผ๋ฅผ ๊ณ„์‚ฐํ•ฉ๋‹ˆ๋‹ค.
  • noul ๊ธฐ๊ถŒ ๋ฐฉ์ง€ ์†์‹ค: ๊ฒ€์ฆ์ž๋Š” 0.2 < p(yes) < 0.8์„ ๊ธฐ๊ถŒ(์˜ค๋‹ต)์œผ๋กœ ์ฒ˜๋ฆฌํ•ฉ๋‹ˆ๋‹ค. ๊ทธ๋ž˜์„œ ํŒ๋… ๋กœ๊ทธ ์˜ค์ฆˆ๊ฐ€ ln 4 + 0.5 ๋ฏธ๋งŒ์ด๋ฉด ํžŒ์ง€ ๋ฒŒ์ ์„ ์ค๋‹ˆ๋‹ค(๊ฐ€์ค‘์น˜ 0.5).
  • ํ•™์Šต ๋‹จ๊ณ„
    1. v1: ์ƒ์„ฑ ๋ฐ์ดํ„ฐ ra_v2๋กœ 600์Šคํ…, ํ•™์Šต๋ฅ  1e-5
    2. v2: ra_v3 ๋ฐ์ดํ„ฐ(ํ…œํ”Œ๋ฆฟ ์ƒ์„ฑ๊ธฐ noulยทscoreยทchoice์™€ ์ ˆ์ฐจํ˜• ๋ณ€ํ˜•, ๊ณต๊ฐœ train)๋กœ 1,830์Šคํ…, ํ•™์Šต๋ฅ  1e-5
    3. ์ด ๋ชจ๋ธ(A): v2์—์„œ ra_v4b ๋ฐ์ดํ„ฐ๋กœ 450์Šคํ…, ํ•™์Šต๋ฅ  5e-6
      • ๊ณต๊ฐœ RA train์„ ๋‚œ์ด๋„๋ณ„๋กœ 8~10๋ฐฐ ๋ฐ˜๋ณตํ–ˆ์Šต๋‹ˆ๋‹ค.
      • ๊ณต๊ฐœ ํŒ์ • ๊ธฐ์ค€๊ณผ ์–ด๊ธ‹๋‚˜๋Š” ์ƒ์„ฑ ๊ฐ€์กฑ์€ ์ค„์˜€์Šต๋‹ˆ๋‹ค.
      • ์ƒ์„ฑ ๋ฌธํ•ญ์˜ ์ •๋‹ต ๋น„์œจ์„ ๊ณต๊ฐœ train ๋ถ„ํฌ์— ๋งž์ท„์Šต๋‹ˆ๋‹ค.
      • noul ๋ชฉํ‘œ๋Š” 0.97, choiceยทscore ๋ชฉํ‘œ๋Š” ๋‚œ์ด๋„๋ณ„๋กœ ๋‘์—ˆ์Šต๋‹ˆ๋‹ค.
  • ๋ฐ์ดํ„ฐ, ์ƒ์„ฑ๊ธฐ, ํ•™์Šต ์ฝ”๋“œ, ๋กœ๊ทธ๋Š” VALOR0316/sn92-ra-work์— ์žˆ์Šต๋‹ˆ๋‹ค.

ํ‰๊ฐ€ (๊ณต๊ฐœ dev 443๋ฌธํ•ญ, ๋ ˆํฌ์˜ ์ฑ„์  ์ฝ”๋“œ)

๋ชจ๋ธ S choice ๋Šฅ๋ ฅ/๋ณด์ • noul ๋Šฅ๋ ฅ/๋ณด์ • score ๋Šฅ๋ ฅ/๋ณด์ •
ํ•™์Šต ์ „ (text-only ๋ณ€ํ™˜๋ณธ) ์•ฝ 26 โ€“ 0 โ€“
v2 68.28 92.3 / 89.0 48.4 / 18.6 77.2 / 57.8
A (์ด ๋ชจ๋ธ) 70.24 94.1 / 89.4 48.4 / 27.3 79.3 / 60.7
  • A์™€ v2์˜ ์ฐจ์ด๋Š” +1.97 ยฑ 2.83(๊ฒ€์ฆ์ž ๋ฐฉ์‹์˜ ์ง์ง€์€ bootstrap ํ‘œ์ค€์˜ค์ฐจ)์œผ๋กœ, ํ†ต๊ณ„์ ์œผ๋กœ ์œ ์˜ํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.
  • ํ•™์Šต ์ˆœ์ „ํŒŒ๋กœ ์žฐ ๊ฐ’์ž…๋‹ˆ๋‹ค. v2์—์„œ๋Š” ๊ฒ€์ฆ์ž์™€ ๊ฐ™์€ vLLM 0.30.0 ํŒ๋…(68.28)๊ณผ ์ผ์น˜ํ–ˆ์Šต๋‹ˆ๋‹ค.
  • sealed ํ‰๊ฐ€๋Š” ๋ฐ›์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค. dev๋ฅผ ํ•™์Šต์— ์“ฐ์ง€ ์•Š์€ ๋ชจ๋ธ์€ sealed๊ฐ€ dev๋ณด๋‹ค ๋ช‡ ์  ๋‚ฎ์€ ๊ฒฝํ–ฅ์ด ์žˆ์Šต๋‹ˆ๋‹ค.

์‚ฌ์šฉ๋ฒ•

  • ํ”„๋กฌํ”„ํŠธ: ๊ฒ€์ฆ์ž ํ”„๋กฌํ”„ํŠธ(reax-decide-prompt/1)๋ฅผ ๊ณ ์ • Qwen ํ…œํ”Œ๋ฆฟ์— ๋„ฃ๊ณ , <think>\n\n</think>\n\n ๋’ค ์ฒซ ์ƒ์„ฑ ์œ„์น˜์—์„œ ์„ ํƒ์ง€ ๊ธ€์ž(A, B, โ€ฆ)์˜ logit์„ ์ฝ์Šต๋‹ˆ๋‹ค.
  • ํŒ๋…: T=2 softmax๋กœ ํ™•๋ฅ ์„ ๋ƒ…๋‹ˆ๋‹ค.

๋ฐ์ดํ„ฐ ์ถœ์ฒ˜์™€ ๋ผ์ด์„ ์Šค

  • ๋ชจ๋ธ: Apache-2.0์ž…๋‹ˆ๋‹ค(๊ธฐ๋ฐ˜ ๋ชจ๋ธ Qwen3.5-9B์˜ LICENSE๋ฅผ ์œ ์ง€).
  • ๊ณต๊ฐœ ๋ฐ์ดํ„ฐ์…‹: ํ•™์Šต ๋ฐ์ดํ„ฐ์— "REAX / decisionmodels, SN92 specialists dataset"(decisionmodels/sn92-specialists, CC-BY-4.0)์˜ train ๋ฌธํ•ญ์ด ๋“ค์–ด ์žˆ์Šต๋‹ˆ๋‹ค.
    • ๊ณต๊ฐœ dev๋Š” ํ•™์Šต์— ์“ฐ์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค.
    • ๊ณต๊ฐœ ๋ฌธํ•ญ์€ ํ”„๋กฌํ”„ํŠธ ํ˜•์‹์œผ๋กœ ๋ Œ๋”๋งํ•˜๊ณ , ๋ชฉํ‘œ ๋ถ„ํฌ๋ฅผ ๋ฐ”๊ฟ” ์‚ฌ์šฉํ–ˆ์Šต๋‹ˆ๋‹ค.
  • ์ƒ์„ฑ ๋ฌธํ•ญ: ์ฝ”๋“œ ๊ทœ์น™์œผ๋กœ ๋งŒ๋“  ์ƒ์„ฑ ๋ฌธํ•ญ์€ Apache-2.0์ž…๋‹ˆ๋‹ค.
Downloads last month
33
Safetensors
Model size
9B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for VALOR0316/sn92-ra-9b-a

Finetuned
Qwen/Qwen3.5-9B
Finetuned
(1136)
this model

Datasets used to train VALOR0316/sn92-ra-9b-a