personaplex-ko-s10-textmix (stage10 step 2600)

s9์— ํ•œ๊ตญ์–ด ์œ„ํ‚ค text-only 20% ํ˜ผํ•ฉ(์˜ค๋””์˜ค ์ฑ„๋„ ๋งˆ์Šคํ‚น)์„ ๋”ํ•œ ์ง€์ . ํ…์ŠคํŠธ ๋‹ค์–‘์„ฑ ํšŒ๋ณต(ํ•ซ ์ƒ˜ํ”Œ๋ง uniq ~0.8-0.9), ์˜ค๋””์˜ค ๋ฌด์†์ƒ(ko_prob ์ตœ๊ณ  0.98). ์ฃผ์˜: ์ด ๋Ÿฐ์˜ ๋งˆ์ง€๋ง‰ ์ฒดํฌํฌ์ธํŠธ(3000)๊ฐ€ ์•„๋‹ˆ๋ผ ๋ฒ ์ŠคํŠธ(2600)๋‹ค โ€” ๊ฐ์‡  ํ›„๋ฐ˜ ๊ณผ๋ฌตํ™” ๋•Œ๋ฌธ.

๋กœ๋”ฉ

  • ํ•™์Šต/๊ฒŒ์ดํŠธ์™€ ๋™์ผํ•œ moshi ๋Ÿฐํƒ€์ž„ ๊ถŒ์žฅ: moshi.models.loaders.get_moshi_lm(model.safetensors) + tokenizer_spm_ko.model
  • HF ๋Ÿฐํƒ€์ž„: dev transformers์˜ PersonaPlexForConditionalGeneration.from_pretrained(<dir>) (config.json ํฌํ•จ๋จ). ๋‹จ, HF ๊ฒฝ๋กœ์˜ selfplay ์ƒ์„ฑ์€ ๋ฌด์Œ ์ด์Šˆ๊ฐ€ ์žˆ์Œ(๋ฆฌํฌํŠธ ยง5 ์ฐธ๊ณ ) โ€” ํ‰๊ฐ€๋Š” moshi ๋Ÿฐํƒ€์ž„ ๊ธฐ์ค€.
  • ํ…์ŠคํŠธ ์ƒ˜ํ”Œ๋ง์€ temp 0.95 / top_k 60 ๊ถŒ์žฅ (0.7/25๋Š” ๋ฐ˜๋ณต ๋ฃจํ”„ ์œ ๋ฐœ).

License / ์‚ฌ์šฉ ๊ณ ์ง€

์ด ๊ฐ€์ค‘์น˜๋Š” nvidia/personaplex-7b-v1์„ ๋ฒ ์ด์Šค๋กœ NIKL(๊ตญ๋ฆฝ๊ตญ์–ด์›) ์ผ์ƒ๋Œ€ํ™” ์ฝ”ํผ์Šค๋กœ ํŒŒ์ธํŠœ๋‹ํ•œ ํŒŒ์ƒ๋ฌผ์ž…๋‹ˆ๋‹ค. ๋ฒ ์ด์Šค ๋ชจ๋ธ์˜ ๋ผ์ด์„ ์Šค๊ฐ€ ์Šน๊ณ„๋˜๋ฉฐ, NIKL ์ฝ”ํผ์Šค ํŒŒ์ƒ๋ฌผ์ด๋ผ๋Š” ์ ์„ ๊ณ ๋ คํ•ด ์—ฐ๊ตฌ ๋ชฉ์  ์‚ฌ์šฉ์„ ๊ถŒ์žฅํ•ฉ๋‹ˆ๋‹ค. ์› ์ฝ”ํผ์Šค ๋ฐ์ดํ„ฐ ์ž์ฒด๋Š” ํฌํ•จ๋˜์–ด ์žˆ์ง€ ์•Š์Šต๋‹ˆ๋‹ค.

Downloads last month
-
Safetensors
Model size
8B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for RetentionLabs/personaplex-ko-s10-textmix

Finetuned
(44)
this model