lemon-mint's picture
Update README.md
05e4a63 verified
metadata
library_name: transformers
language:
  - ko
license: gemma
tags:
  - gemma
  - pytorch
  - instruct
  - finetune
  - translation
widget:
  - messages:
      - role: user
        content: Hamsters don't eat cats.
inference:
  parameters:
    max_new_tokens: 2048
base_model: beomi/gemma-ko-2b
datasets:
  - traintogpb/aihub-flores-koen-integrated-sparta-30k
  - lemon-mint/korean_high_quality_translation_426k
pipeline_tag: text-generation

Gemma 2B Translation v0.121

  • Eval Loss: 0.3734
  • Train Loss: 0.3929
  • lr: 6e-05
  • optimizer: adamw
  • lr_scheduler_type: cosine

Prompt Template

<bos>##English##

Hamsters don't eat cats.

##Korean##

ํ–„์Šคํ„ฐ๋Š” ๊ณ ์–‘์ด๋ฅผ ๋จน์ง€ ์•Š์Šต๋‹ˆ๋‹ค.<eos>
<bos>##Korean##

ํ–„์Šคํ„ฐ๋Š” ๊ณ ์–‘์ด๋ฅผ ๋จน์ง€ ์•Š์Šต๋‹ˆ๋‹ค.

##English##

Hamsters don't eat cats.<eos>

Model Description