noahkim's picture
Update README.md
73b29ae
|
raw
history blame
1.17 kB
metadata
language: ko
inference: false
widget:
  - text: hello this is an example
tags:
  - summarization
  - bigbird
  - EncoderDecoderModel

<<20220916 Commit>>

๊ธด ๋ฌธ์žฅ์˜ ์š”์•ฝ ๋ชจ๋ธ ํŠนํ™”๋œ ๋ชจ๋ธ์„ ๋งŒ๋“ค๊ธฐ ์œ„ํ•ด KoBigBird ๋ชจ๋ธ์„ Encoder Decoder ํ˜•ํƒœ๋กœ ๋ณ€ํ™˜ํ•œ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค. monologg๋‹˜์ด ๋งŒ๋“ค์–ด ๋†“์œผ์‹  KoBigBird ๋ชจ๋ธ์€ bert ๊ธฐ๋ฐ˜์œผ๋กœ ๋งŒ๋“ค์–ด์ ธ ์žˆ๊ธฐ ๋•Œ๋ฌธ์— Q&A ๋“ฑ ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ Task์— ์ข‹์€ ์„ฑ๋Šฅ์„ ๋ณด์ž…๋‹ˆ๋‹ค. ์ €๋Š” ์š”์•ฝ(Summarization) Task๋ฅผ ์œ„ํ•ด์„œ Encoder-Decoder ํ˜•ํƒœ์˜ ๋ชจ์–‘์œผ๋กœ ๋ฐ”๊ฟจ์Šต๋‹ˆ๋‹ค. ์ถ”ํ›„ ์ง€์†์ ์ธ ์—…๋ฐ์ดํŠธ๋กœ ๋ณ„๋„์˜ ๋ถˆํŽธํ•จ ์—†์ด ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋„๋ก ๋ฐ”๊พธ๊ฒ ์Šต๋‹ˆ๋‹ค.


# Python Code
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM

tokenizer = AutoTokenizer.from_pretrained("noahkim/kobigbird-finetuned-Encoder-Decoder")
model = AutoModelForSeq2SeqLM.from_pretrained("noahkim/kobigbird-finetuned-Encoder-Decoder")