|
--- |
|
library_name: peft |
|
base_model: EleutherAI/polyglot-ko-5.8b |
|
--- |
|
|
|
# ChaeMs/KoRani-5.8b |
|
|
|
<p align="center"><img width="150" alt="image" src="https://github.com/chaeminsoo/QnA_GPT/assets/79351899/b9a78bf5-0d80-435a-ba14-e288e8886f99"></p> |
|
|
|
<!-- Provide a quick summary of what the model is/does. --> |
|
|
|
The korean language model finetuned from EleutherAI's polyglot-ko-5.8b, using QLoRA method. |
|
It trained about 100k instruction data. |
|
|
|
Instruction data was made using "๋ค์ด๋ฒ ์ง์์ธ" and ShareGPT data. |
|
|
|
|
|
## Model Description |
|
|
|
<!-- Provide a longer summary of what this model is. --> |
|
|
|
- **Developed by:** [Chae Minsu](https://github.com/chaeminsoo) |
|
- **Model type:** Text Generation |
|
- **Language(s) (NLP):** Korean |
|
- **Finetuned from model:** EleutherAI/polyglot-ko-5.8b |
|
- **Training Data:** [๋ค์ด๋ฒ ์ง์์ธ data made by beomi](https://huggingface.co/datasets/beomi/KoAlpaca-v1.1a), [ShareGPT data made by junelee](https://huggingface.co/datasets/junelee/sharegpt_deepl_ko) |
