"WelSSiSKo : Welfare Domain Specific Model"


Github ▼

If you want to get how to use this model, please check my github repository :)
👉 Github Repo

Open In Colab

What is BaseModel ▼

👉 beomi/llama-2-ko-7b

Training procedure ▼

The following bitsandbytes quantization config was used during training:

  • load_in_4bit: True
  • bnb_4bit_quant_type: nf4
  • bnb_4bit_use_double_quant: False
  • bnb_4bit_compute_dtype: float16

Framework versions ▼

  • PEFT 0.8.2.

Evaluate Score

  • 적절한 Domain Benchmark Set이 없기때문에 정성평가를 진행하였고 그에 따른 AVG Score는 0.74 입니다.

image/png

Downloads last month
22
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Model tree for Ash-Hun/WelSSiSKo_v3_llama-2-ko-base_text-generation

Adapter
(19)
this model

Dataset used to train Ash-Hun/WelSSiSKo_v3_llama-2-ko-base_text-generation