noahkim's picture
Update README.md
73b29ae
---
language: ko
inference: false
widget:
- text: 'hello this is an example'
tags:
- summarization
- bigbird
- EncoderDecoderModel
---
- This model is a [kobigbird-bert-base](https://huggingface.co/monologg/kobigbird-bert-base) finetuned on the [naver-news-summarization-ko](https://huggingface.co/datasets/daekeun-ml/naver-news-summarization-ko)
<<20220916 Commit>>
๊ธด ๋ฌธ์žฅ์˜ ์š”์•ฝ ๋ชจ๋ธ ํŠนํ™”๋œ ๋ชจ๋ธ์„ ๋งŒ๋“ค๊ธฐ ์œ„ํ•ด KoBigBird ๋ชจ๋ธ์„ Encoder Decoder ํ˜•ํƒœ๋กœ ๋ณ€ํ™˜ํ•œ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.
monologg๋‹˜์ด ๋งŒ๋“ค์–ด ๋†“์œผ์‹  KoBigBird ๋ชจ๋ธ์€ bert ๊ธฐ๋ฐ˜์œผ๋กœ ๋งŒ๋“ค์–ด์ ธ ์žˆ๊ธฐ ๋•Œ๋ฌธ์— Q&A ๋“ฑ ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ Task์— ์ข‹์€ ์„ฑ๋Šฅ์„ ๋ณด์ž…๋‹ˆ๋‹ค.
์ €๋Š” ์š”์•ฝ(Summarization) Task๋ฅผ ์œ„ํ•ด์„œ Encoder-Decoder ํ˜•ํƒœ์˜ ๋ชจ์–‘์œผ๋กœ ๋ฐ”๊ฟจ์Šต๋‹ˆ๋‹ค.
์ถ”ํ›„ ์ง€์†์ ์ธ ์—…๋ฐ์ดํŠธ๋กœ ๋ณ„๋„์˜ ๋ถˆํŽธํ•จ ์—†์ด ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋„๋ก ๋ฐ”๊พธ๊ฒ ์Šต๋‹ˆ๋‹ค.
<pre><code>
# Python Code
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("noahkim/kobigbird-finetuned-Encoder-Decoder")
model = AutoModelForSeq2SeqLM.from_pretrained("noahkim/kobigbird-finetuned-Encoder-Decoder")
</pre></code>