HyperCLOVA X U-CURATE Random Epoch3 Merged v0.2

Powered by HyperCLOVA X

2026 K-DS ํ•ด์ปคํ†ค ์˜ˆ์„  ๋ฐ K-AI ๋ฆฌ๋”๋ณด๋“œ ํ‰๊ฐ€๋ฅผ ์œ„ํ•ด ๋งŒ๋“  ์‹คํ—˜์šฉ ํ•œ๊ตญ์–ด fine-tuned model์ž…๋‹ˆ๋‹ค. HyperCLOVA X SEED Text Instruct 1.5B์˜ ๊ณ ์ • revision์— U-CURATE Random QLoRA adapter๋ฅผ ๋ณ‘ํ•ฉํ–ˆ์Šต๋‹ˆ๋‹ค. ๋ณ„๋„ base model์ด๋‚˜ PEFT adapter ์—†์ด AutoModelForCausalLM๊ณผ vLLM์—์„œ ์ง์ ‘ ์ฝ์„ ์ˆ˜ ์žˆ๋Š” BF16 standalone full-model artifact์ž…๋‹ˆ๋‹ค.

๋ชจ๋ธ ์ •๋ณด

  • Base: naver-hyperclovax/HyperCLOVAX-SEED-Text-Instruct-1.5B
  • Base revision: 0728a47d632019a8da5f53b663db1c175dc04115
  • Architecture: LlamaForCausalLM
  • Format: BF16 sharded safetensors
  • Fine-tuning: 4-bit NF4 QLoRA, assistant-only masking
  • Adapter SHA-256: 55280d552281b2c5659d3a047bcf4ee5bf540ac1f1ff8da0d854eaf8771bc954

ํ•™์Šต ์š”์•ฝ

  • Unique training samples: 400 (AIHUB_71533, AIHUB_569)
  • Epochs: 3
  • Sample presentations: 1,200
  • Optimizer steps: 150
  • Batch 1, gradient accumulation 8, seed 42
  • Learning rate: 1e-4, cosine scheduler
  • Formatted tokens: 896,493
  • Supervised tokens: 12,909

๋‚ด๋ถ€ ๊ฒ€์ฆ

๋™์ผํ•œ ๊ณ ์ • holdout 200๊ฑด์—์„œ primary metric์€ 0.523114์˜€์Šต๋‹ˆ๋‹ค. ์ด ๊ฐ’์€ single-seed two-source proxy ๊ฒฐ๊ณผ์ด๋ฉฐ ๊ณต์‹ K-AI ์ ์ˆ˜๊ฐ€ ์•„๋‹™๋‹ˆ๋‹ค. 1-epoch ๊ธฐ์กด Random baseline์˜ ๋‚ด๋ถ€ primary 0.433489์™€ ๋น„๊ตํ•˜๋Š” epoch-control ์‹คํ—˜์ž…๋‹ˆ๋‹ค.

Transformers

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "hoySky92/HyperCLOVA-X-U-CURATE-Random-Epoch3-Merged-v0.2"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    dtype=torch.bfloat16,
    device_map="auto",
)

vLLM

vllm serve hoySky92/HyperCLOVA-X-U-CURATE-Random-Epoch3-Merged-v0.2 --dtype bfloat16

ํ•œ๊ณ„

  • 400๊ฑด, 2๊ฐœ AI Hub source, single seed ๊ธฐ๋ฐ˜์˜ ์†Œ๊ทœ๋ชจ ์‹คํ—˜ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.
  • ๋ณธ ๋ชจ๋ธ์˜ ๋‚ด๋ถ€ ์ ์ˆ˜ ํ–ฅ์ƒ์ด ๊ณต์‹ K-AI ์ ์ˆ˜ ํ–ฅ์ƒ์„ ๋ณด์žฅํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.
  • ์ผ๋ฐ˜ ํ•œ๊ตญ์–ด ์„ฑ๋Šฅ, ์‚ฌ์‹ค์„ฑ, ์•ˆ์ „์„ฑ ๋ฐ ํŽธํ–ฅ์„ ๋ณด์žฅํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.
  • ๊ณ ์œ„ํ—˜ ์˜์‚ฌ๊ฒฐ์ •์—๋Š” ์‚ฌ์šฉํ•˜์ง€ ๋งˆ์‹ญ์‹œ์˜ค.

๋ผ์ด์„ ์Šค

์ด derivative model์€ ์ €์žฅ์†Œ์— ํฌํ•จ๋œ HyperCLOVA X SEED Model License Agreement๋ฅผ ๋”ฐ๋ฆ…๋‹ˆ๋‹ค. ์ „์ฒด ์กฐ๊ฑด์€ LICENSE, ๋ณ€๊ฒฝ ์‚ฌํ•ญ์€ MODIFICATIONS.md, ๊ณ ์ง€๋Š” NOTICE๋ฅผ ํ™•์ธํ•˜์‹ญ์‹œ์˜ค.

Downloads last month
324
Safetensors
Model size
2B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for hoySky92/HyperCLOVA-X-U-CURATE-Random-Epoch3-Merged-v0.2