ahassoun's picture
Upload 3018 files
ee6e328
|
raw
history blame
No virus
27.8 kB

์ปค๋ฎค๋‹ˆํ‹ฐ [[community]]

์ด ํŽ˜์ด์ง€๋Š” ์ปค๋ฎค๋‹ˆํ‹ฐ์—์„œ ๊ฐœ๋ฐœํ•œ ๐Ÿค— Transformers ๋ฆฌ์†Œ์Šค๋ฅผ ์žฌ๊ตฌ์„ฑํ•œ ํŽ˜์ด์ง€์ž…๋‹ˆ๋‹ค.

์ปค๋ฎค๋‹ˆํ‹ฐ ๋ฆฌ์†Œ์Šค: [[community-resources]]

๋ฆฌ์†Œ์Šค ์„ค๋ช… ๋งŒ๋“ ์ด
Hugging Face Transformers ์šฉ์–ด์ง‘ ํ”Œ๋ž˜์‹œ์นด๋“œ Transformers ๋ฌธ์„œ ์šฉ์–ด์ง‘์„ ๊ธฐ๋ฐ˜์œผ๋กœ ํ•œ ํ”Œ๋ž˜์‹œ์นด๋“œ ์„ธํŠธ๋กœ, ์ง€์‹์„ ์žฅ๊ธฐ์ ์œผ๋กœ ์œ ์ง€ํ•˜๊ธฐ ์œ„ํ•ด ํŠน๋ณ„ํžˆ ์„ค๊ณ„๋œ ์˜คํ”ˆ์†Œ์Šค ํฌ๋กœ์Šค ํ”Œ๋žซํผ ์•ฑ์ธ Anki๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์‰ฝ๊ฒŒ ํ•™์Šต/์ˆ˜์ •ํ•  ์ˆ˜ ์žˆ๋Š” ํ˜•ํƒœ๋กœ ์ œ์ž‘๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ํ”Œ๋ž˜์‹œ์นด๋“œ ์‚ฌ์šฉ๋ฒ•์— ๋Œ€ํ•œ ์†Œ๊ฐœ ๋™์˜์ƒ์„ ์ฐธ์กฐํ•˜์„ธ์š”. Darigov ๋ฆฌ์„œ์น˜

์ปค๋ฎค๋‹ˆํ‹ฐ ๋…ธํŠธ๋ถ: [[community-notebooks]]

๋…ธํŠธ๋ถ ์„ค๋ช… ๋งŒ๋“ ์ด
๊ฐ€์‚ฌ๋ฅผ ์ƒ์„ฑํ•˜๊ธฐ ์œ„ํ•ด ์‚ฌ์ „ํ›ˆ๋ จ๋œ ํŠธ๋žœ์Šคํฌ๋จธ๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ GPT-2 ๋ชจ๋ธ์„ ๋ฏธ์„ธ ์กฐ์ •ํ•˜์—ฌ ์ข‹์•„ํ•˜๋Š” ์•„ํ‹ฐ์ŠคํŠธ์˜ ์Šคํƒ€์ผ๋กœ ๊ฐ€์‚ฌ๋ฅผ ์ƒ์„ฑํ•˜๋Š” ๋ฐฉ๋ฒ• Aleksey Korshuk Open In Colab
Tensorflow 2๋กœ T5 ํ›ˆ๋ จํ•˜๊ธฐ Tensorflow 2๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ T5๋ฅผ ํ›ˆ๋ จ์‹œํ‚ค๋Š” ๋ฐฉ๋ฒ•. ์ด ๋…ธํŠธ๋ถ์€ Tensorflow 2๋กœ SQUAD๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๊ตฌํ˜„ํ•œ ์งˆ์˜์‘๋‹ต ์ž‘์—…์„ ๋ณด์—ฌ์ค๋‹ˆ๋‹ค. Muhammad Harris Open In Colab
TPU์—์„œ T5 ํ›ˆ๋ จํ•˜๊ธฐ Transformers์™€ Nlp๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ SQUAD๋กœ T5๋ฅผ ํ›ˆ๋ จํ•˜๋Š” ๋ฐฉ๋ฒ• Suraj Patil Open In Colab
๋ถ„๋ฅ˜ ๋ฐ ๊ฐ๊ด€์‹ ๋ฌธ์ œ๋ฅผ ์œ„ํ•ด T5 ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ๋ถ„๋ฅ˜ ๋ฐ ๊ฐ๊ด€์‹ ๋ฌธ์ œ์— ๋งž๊ฒŒ ํ…์ŠคํŠธ-ํ…์ŠคํŠธ ํ˜•์‹์„ ์‚ฌ์šฉํ•˜์—ฌ PyTorch Lightning์œผ๋กœ T5๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Suraj Patil Open In Colab
์ƒˆ๋กœ์šด ๋ฐ์ดํ„ฐ ์„ธํŠธ์™€ ์–ธ์–ด๋กœ DialoGPT ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ์ž์œ  ๋Œ€ํ™”ํ˜• ์ฑ—๋ด‡์„ ๋งŒ๋“ค๊ธฐ ์œ„ํ•ด ์ƒˆ๋กœ์šด ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ DialoGPT ๋ชจ๋ธ์„ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Nathan Cooper Open In Colab
Reformer๋กœ ๊ธด ์‹œํ€€์Šค ๋ชจ๋ธ๋งํ•˜๊ธฐ Reformer๋กœ ์ตœ๋Œ€ 50๋งŒ ํ† ํฐ์˜ ์‹œํ€€์Šค๋ฅผ ํ›ˆ๋ จํ•˜๋Š” ๋ฐฉ๋ฒ• Patrick von Platen Open In Colab
์š”์•ฝ์„ ์œ„ํ•ด BART ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ blurr๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ fastai๋กœ ์š”์•ฝํ•˜๊ธฐ ์œ„ํ•ด BART๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Wayde Gilliam Open In Colab
๋‹ค๋ฅธ ์‚ฌ๋žŒ์˜ ํŠธ์œ—์œผ๋กœ ์‚ฌ์ „ํ›ˆ๋ จ๋œ ํŠธ๋žœ์Šคํฌ๋จธ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ GPT-2 ๋ชจ๋ธ์„ ๋ฏธ์„ธ ์กฐ์ •ํ•˜์—ฌ ์ข‹์•„ํ•˜๋Š” ํŠธ์œ„ํ„ฐ ๊ณ„์ • ์Šคํƒ€์ผ๋กœ ํŠธ์œ—์„ ์ƒ์„ฑํ•˜๋Š” ๋ฐฉ๋ฒ• Boris Dayma Open In Colab
Weights & Biases๋กœ ๐Ÿค— Hugging Face ๋ชจ๋ธ ์ตœ์ ํ™”ํ•˜๊ธฐ W&B์™€ Hugging Face์˜ ํ†ตํ•ฉ์„ ๋ณด์—ฌ์ฃผ๋Š” ์ „์ฒด ํŠœํ† ๋ฆฌ์–ผ Boris Dayma Open In Colab
Longformer ์‚ฌ์ „ํ›ˆ๋ จํ•˜๊ธฐ ๊ธฐ์กด ์‚ฌ์ „ํ›ˆ๋ จ๋œ ๋ชจ๋ธ์˜ "๊ธด" ๋ฒ„์ „์„ ๋นŒ๋“œํ•˜๋Š” ๋ฐฉ๋ฒ• Iz Beltagy Open In Colab
QA๋ฅผ ์œ„ํ•ด Longformer ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ QA ์ž‘์—…์„ ์œ„ํ•ด Longformer๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Suraj Patil Open In Colab
๐Ÿค— Nlp๋กœ ๋ชจ๋ธ ํ‰๊ฐ€ํ•˜๊ธฐ Nlp๋กœ TriviaQA์—์„œ Longformer๋ฅผ ํ‰๊ฐ€ํ•˜๋Š” ๋ฐฉ๋ฒ• Patrick von Platen Open In Colab
๊ฐ์ • ๋ฒ”์œ„ ์ถ”์ถœ์„ ์œ„ํ•ด T5 ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ๊ฐ์ • ๋ฒ”์œ„ ์ถ”์ถœ์„ ์œ„ํ•ด ํ…์ŠคํŠธ-ํ…์ŠคํŠธ ํ˜•์‹์„ ์‚ฌ์šฉํ•˜์—ฌ PyTorch Lightning์œผ๋กœ T5๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Lorenzo Ampil Open In Colab
๋‹ค์ค‘ ํด๋ž˜์Šค ๋ถ„๋ฅ˜๋ฅผ ์œ„ํ•ด DistilBert ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ๋‹ค์ค‘ ํด๋ž˜์Šค ๋ถ„๋ฅ˜๋ฅผ ์œ„ํ•ด PyTorch๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ DistilBert๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Abhishek Kumar Mishra Open In Colab
๋‹ค์ค‘ ๋ ˆ์ด๋ธ” ๋ถ„๋ฅ˜๋ฅผ ์œ„ํ•ด BERT ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ๋‹ค์ค‘ ๋ ˆ์ด๋ธ” ๋ถ„๋ฅ˜๋ฅผ ์œ„ํ•ด PyTorch๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ BERT๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Abhishek Kumar Mishra Open In Colab
์š”์•ฝ์„ ์œ„ํ•ด T5 ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ์š”์•ฝ์„ ์œ„ํ•ด PyTorch๋กœ T5๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ณ  WandB๋กœ ์‹คํ—˜์„ ์ถ”์ ํ•˜๋Š” ๋ฐฉ๋ฒ• Abhishek Kumar Mishra Open In Colab
๋™์  ํŒจ๋”ฉ/๋ฒ„์ผ“ํŒ…์œผ๋กœ Transformers ๋ฏธ์„ธ ์กฐ์ • ์†๋„ ๋†’์ด๊ธฐ ๋™์  ํŒจ๋”ฉ/๋ฒ„์ผ“ํŒ…์„ ์‚ฌ์šฉํ•˜์—ฌ ๋ฏธ์„ธ ์กฐ์ • ์†๋„๋ฅผ 2๋ฐฐ๋กœ ๋†’์ด๋Š” ๋ฐฉ๋ฒ• Michael Benesty Open In Colab
๋งˆ์Šคํ‚น๋œ ์–ธ์–ด ๋ชจ๋ธ๋ง์„ ์œ„ํ•ด Reformer ์‚ฌ์ „ํ›ˆ๋ จํ•˜๊ธฐ ์–‘๋ฐฉํ–ฅ ์…€ํ”„ ์–ดํ…์…˜ ๋ ˆ์ด์–ด๋ฅผ ์ด์šฉํ•ด์„œ Reformer ๋ชจ๋ธ์„ ํ›ˆ๋ จํ•˜๋Š” ๋ฐฉ๋ฒ• Patrick von Platen Open In Colab
Sci-BERT ํ™•์žฅ ๋ฐ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ CORD ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ AllenAI์—์„œ ์‚ฌ์ „ํ›ˆ๋ จ๋œ SciBERT ๋ชจ๋ธ์˜ ์–ดํœ˜๋ฅผ ๋Š˜๋ฆฌ๊ณ  ํŒŒ์ดํ”„๋ผ์ธ์„ ๊ตฌ์ถ•ํ•˜๋Š” ๋ฐฉ๋ฒ• Tanmay Thakur Open In Colab
์š”์•ฝ์„ ์œ„ํ•ด Trainer API๋กœ BlenderBotSmall ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ์š”์•ฝ์„ ์œ„ํ•ด Trainer API๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์‚ฌ์šฉ์ž ์ง€์ • ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ BlenderBotSmall ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ Tanmay Thakur Open In Colab
ํ†ตํ•ฉ ๊ธฐ์šธ๊ธฐ(Integrated Gradient)๋ฅผ ์ด์šฉํ•˜์—ฌ Electra ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ณ  ํ•ด์„ํ•˜๊ธฐ ๊ฐ์ • ๋ถ„์„์„ ์œ„ํ•ด Electra๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ณ  Captum ํ†ตํ•ฉ ๊ธฐ์šธ๊ธฐ๋กœ ์˜ˆ์ธก์„ ํ•ด์„ํ•˜๋Š” ๋ฐฉ๋ฒ• Eliza Szczechla Open In Colab
Trainer ํด๋ž˜์Šค๋กœ ๋น„์˜์–ด๊ถŒ GPT-2 ๋ชจ๋ธ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ Trainer ํด๋ž˜์Šค๋กœ ๋น„์˜์–ด๊ถŒ GPT-2 ๋ชจ๋ธ์„ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Philipp Schmid Open In Colab
๋‹ค์ค‘ ๋ผ๋ฒจ ๋ถ„๋ฅ˜ ์ž‘์—…์„ ์œ„ํ•ด DistilBERT ๋ชจ๋ธ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ๋‹ค์ค‘ ๋ผ๋ฒจ ๋ถ„๋ฅ˜ ์ž‘์—…์„ ์œ„ํ•ด DistilBERT ๋ชจ๋ธ์„ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Dhaval Taunk Open In Colab
๋ฌธ์žฅ์Œ ๋ถ„๋ฅ˜๋ฅผ ์œ„ํ•ด ALBERT ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ๋ฌธ์žฅ์Œ ๋ถ„๋ฅ˜ ์ž‘์—…์„ ์œ„ํ•ด ALBERT ๋ชจ๋ธ ๋˜๋Š” ๋‹ค๋ฅธ BERT ๊ธฐ๋ฐ˜ ๋ชจ๋ธ์„ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Nadir El Manouzi Open In Colab
๊ฐ์ • ๋ถ„์„์„ ์œ„ํ•ด Roberta ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ๊ฐ์ • ๋ถ„์„์„ ์œ„ํ•ด Roberta ๋ชจ๋ธ์„ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Dhaval Taunk Open In Colab
์งˆ๋ฌธ ์ƒ์„ฑ ๋ชจ๋ธ ํ‰๊ฐ€ํ•˜๊ธฐ seq2seq ํŠธ๋žœ์Šคํฌ๋จธ ๋ชจ๋ธ์ด ์ƒ์„ฑํ•œ ์งˆ๋ฌธ๊ณผ ์ด์— ๋Œ€ํ•œ ๋‹ต๋ณ€์ด ์–ผ๋งˆ๋‚˜ ์ •ํ™•ํ•œ๊ฐ€์š”? Pascal Zoleko Open In Colab
DistilBERT์™€ Tensorflow๋กœ ํ…์ŠคํŠธ ๋ถ„๋ฅ˜ํ•˜๊ธฐ ํ…์ŠคํŠธ ๋ถ„๋ฅ˜๋ฅผ ์œ„ํ•ด TensorFlow๋กœ DistilBERT๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Peter Bayerle Open In Colab
CNN/Dailail ์š”์•ฝ์„ ์œ„ํ•ด ์ธ์ฝ”๋”-๋””์ฝ”๋” ๋ชจ๋ธ์— BERT ํ™œ์šฉํ•˜๊ธฐ CNN/Dailail ์š”์•ฝ์„ ์œ„ํ•ด bert-base-uncased ์ฒดํฌํฌ์ธํŠธ๋ฅผ ํ™œ์šฉํ•˜์—ฌ EncoderDecoderModel์„ ์›Œ๋ฐ์—…ํ•˜๋Š” ๋ฐฉ๋ฒ• Patrick von Platen Open In Colab
BBC XSum ์š”์•ฝ์„ ์œ„ํ•ด ์ธ์ฝ”๋”-๋””์ฝ”๋” ๋ชจ๋ธ์— RoBERTa ํ™œ์šฉํ•˜๊ธฐ BBC/XSum ์š”์•ฝ์„ ์œ„ํ•ด roberta-base ์ฒดํฌํฌ์ธํŠธ๋ฅผ ํ™œ์šฉํ•˜์—ฌ ๊ณต์œ  EncoderDecoderModel์„ ์›Œ๋ฐ์—…ํ•˜๋Š” ๋ฐฉ๋ฒ• Patrick von Platen Open In Colab
์ˆœ์ฐจ์  ์งˆ๋ฌธ ๋‹ต๋ณ€(SQA)์„ ์œ„ํ•ด TAPAS ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ tapas-base ์ฒดํฌํฌ์ธํŠธ๋ฅผ ํ™œ์šฉํ•˜์—ฌ ์ˆœ์ฐจ์  ์งˆ๋ฌธ ๋‹ต๋ณ€(SQA) ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ TapasForQuestionAnswering์„ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Niels Rogge Open In Colab
ํ‘œ ์‚ฌ์‹ค ๊ฒ€์‚ฌ(TabFact)๋กœ TAPAS ํ‰๊ฐ€ํ•˜๊ธฐ ๐Ÿค— Datasets์™€ ๐Ÿค— Transformer ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋ฅผ ํ•จ๊ป˜ ์‚ฌ์šฉํ•˜์—ฌ tapas-base-finetuned-tabfact ์ฒดํฌํฌ์ธํŠธ๋กœ ๋ฏธ์„ธ ์กฐ์ •๋œ TapasForSequenceClassification์„ ํ‰๊ฐ€ํ•˜๋Š” ๋ฐฉ๋ฒ• Niels Rogge Open In Colab
๋ฒˆ์—ญ์„ ์œ„ํ•ด mBART ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ํžŒ๋””์–ด์—์„œ ์˜์–ด๋กœ ๋ฒˆ์—ญํ•˜๊ธฐ ์œ„ํ•ด Seq2SeqTrainer๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ mBART๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Vasudev Gupta Open In Colab
FUNSD(์–‘์‹ ์ดํ•ด ๋ฐ์ดํ„ฐ ์„ธํŠธ)๋กœ LayoutLM ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ์Šค์บ”ํ•œ ๋ฌธ์„œ์—์„œ ์ •๋ณด ์ถ”์ถœ์„ ์œ„ํ•ด FUNSD ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ LayoutLMForTokenClassification์„ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Niels Rogge Open In Colab
DistilGPT2 ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ณ  ๋ฐ ํ…์ŠคํŠธ ์ƒ์„ฑํ•˜๊ธฐ DistilGPT2๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ณ  ํ…์ŠคํŠธ๋ฅผ ์ƒ์„ฑํ•˜๋Š” ๋ฐฉ๋ฒ• Aakash Tripathi Open In Colab
์ตœ๋Œ€ 8K ํ† ํฐ์—์„œ LED ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ๊ธด ๋ฒ”์œ„๋ฅผ ์š”์•ฝํ•˜๊ธฐ ์œ„ํ•ด PubMed๋กœ LED๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Patrick von Platen Open In Colab
Arxiv๋กœ LED ํ‰๊ฐ€ํ•˜๊ธฐ ๊ธด ๋ฒ”์œ„ ์š”์•ฝ์— ๋Œ€ํ•ด LED๋ฅผ ํšจ๊ณผ์ ์œผ๋กœ ํ‰๊ฐ€ํ•˜๋Š” ๋ฐฉ๋ฒ• Patrick von Platen Open In Colab
RVL-CDIP(๋ฌธ์„œ ์ด๋ฏธ์ง€ ๋ถ„๋ฅ˜ ๋ฐ์ดํ„ฐ ์„ธํŠธ)๋กœ LayoutLM ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ) ์Šค์บ” ๋ฌธ์„œ ๋ถ„๋ฅ˜๋ฅผ ์œ„ํ•ด RVL-CDIP ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ LayoutLMForSequenceClassification์„ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Niels Rogge Open In Colab
GPT2 ์กฐ์ •์„ ํ†ตํ•œ Wav2Vec2 CTC ๋””์ฝ”๋”ฉ ์–ธ์–ด ๋ชจ๋ธ ์กฐ์ •์„ ํ†ตํ•ด CTC ์‹œํ€€์Šค๋ฅผ ๋””์ฝ”๋”ฉํ•˜๋Š” ๋ฐฉ๋ฒ• Eric Lam Open In Colab
Trainer ํด๋ž˜์Šค๋กœ ๋‘ ๊ฐœ ์–ธ์–ด๋กœ ์š”์•ฝํ•˜๊ธฐ ์œ„ํ•ด BART ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ Trainer ํด๋ž˜์Šค๋กœ ๋‘ ๊ฐœ ์–ธ์–ด๋กœ ์š”์•ฝํ•˜๊ธฐ ์œ„ํ•ด BART ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Eliza Szczechla Open In Colab
Trivia QA๋กœ Big Bird ํ‰๊ฐ€ํ•˜๊ธฐ Trivia QA๋กœ ๊ธด ๋ฌธ์„œ ์งˆ๋ฌธ์— ๋Œ€ํ•œ ๋‹ต๋ณ€์— ๋Œ€ํ•ด BigBird๋ฅผ ํ‰๊ฐ€ํ•˜๋Š” ๋ฐฉ๋ฒ• Patrick von Platen Open In Colab
Wav2Vec2๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๋™์˜์ƒ ์บก์…˜ ๋งŒ๋“ค๊ธฐ Wav2Vec์œผ๋กœ ์˜ค๋””์˜ค๋ฅผ ํ…์ŠคํŠธ๋กœ ๋ณ€ํ™˜ํ•˜์—ฌ ๋ชจ๋“  ๋™์˜์ƒ์—์„œ YouTube ์บก์…˜ ๋งŒ๋“œ๋Š” ๋ฐฉ๋ฒ• Niklas Muennighoff Open In Colab
PyTorch Lightning์„ ์‚ฌ์šฉํ•˜์—ฌ CIFAR-10์œผ๋กœ ๋น„์ „ ํŠธ๋žœ์Šคํฌ๋จธ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ HuggingFace Transformers, Datasets, PyTorch Lightning์„ ์‚ฌ์šฉํ•˜์—ฌ CIFAR-10์œผ๋กœ ๋น„์ „ ํŠธ๋žœ์Šคํฌ๋จธ(ViT)๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Niels Rogge Open In Colab
๐Ÿค— Trainer๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ CIFAR-10์—์„œ ๋น„์ „ ํŠธ๋žœ์Šคํฌ๋จธ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ Datasets, ๐Ÿค— Trainer๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ CIFAR-10์—์„œ ๋น„์ „ ํŠธ๋žœ์Šคํฌ๋จธ(ViT)๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Niels Rogge Open In Colab
๊ฐœ์ฒด ์ž…๋ ฅ ๋ฐ์ดํ„ฐ ์„ธํŠธ์ธ Open Entity๋กœ LUKE ํ‰๊ฐ€ํ•˜๊ธฐ Open Entity ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ LukeForEntityClassification์„ ํ‰๊ฐ€ํ•˜๋Š” ๋ฐฉ๋ฒ• Ikuya Yamada Open In Colab
๊ด€๊ณ„ ์ถ”์ถœ ๋ฐ์ดํ„ฐ ์„ธํŠธ์ธ TACRED๋กœ LUKE ํ‰๊ฐ€ํ•˜๊ธฐ TACRED ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ LukeForEntityPairClassification์„ ํ‰๊ฐ€ํ•˜๋Š” ๋ฐฉ๋ฒ• Ikuya Yamada Open In Colab
์ค‘์š” NER ๋ฒค์น˜๋งˆํฌ์ธ CoNLL-2003์œผ๋กœ LUKE ํ‰๊ฐ€ํ•˜๊ธฐ CoNLL-2003 ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ LukeForEntitySpanClassification๋ฅผ ํ‰๊ฐ€ํ•˜๋Š” ๋ฐฉ๋ฒ• Ikuya Yamada Open In Colab
PubMed ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ BigBird-Pegasus ํ‰๊ฐ€ํ•˜๊ธฐ PubMed ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ BigBirdPegasusForConditionalGeneration๋ฅผ ํ‰๊ฐ€ํ•˜๋Š” ๋ฐฉ๋ฒ• Vasudev Gupta Open In Colab
Wav2Vec2๋ฅผ ์‚ฌ์šฉํ•ด์„œ ์Œ์„ฑ ๊ฐ์ • ๋ถ„๋ฅ˜ํ•˜๊ธฐ ๊ฐ์ • ๋ถ„๋ฅ˜๋ฅผ ์œ„ํ•ด ์‚ฌ์ „ํ›ˆ๋ จ๋œ Wav2Vec2 ๋ชจ๋ธ์„ MEGA ๋ฐ์ดํ„ฐ ์„ธํŠธ์— ํ™œ์šฉํ•˜๋Š” ๋ฐฉ๋ฒ• Mehrdad Farahani Open In Colab
DETR๋กœ ์ด๋ฏธ์ง€์—์„œ ๊ฐ์ฒด ํƒ์ง€ํ•˜๊ธฐ ํ›ˆ๋ จ๋œ DetrForObjectDetection ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•˜์—ฌ ์ด๋ฏธ์ง€์—์„œ ๊ฐ์ฒด๋ฅผ ํƒ์ง€ํ•˜๊ณ  ์–ดํ…์…˜์„ ์‹œ๊ฐํ™”ํ•˜๋Š” ๋ฐฉ๋ฒ• Niels Rogge Open In Colab
์‚ฌ์šฉ์ž ์ง€์ • ๊ฐ์ฒด ํƒ์ง€ ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ DETR ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ์‚ฌ์šฉ์ž ์ง€์ • ๊ฐ์ฒด ํƒ์ง€ ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ DetrForObjectDetection์„ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Niels Rogge Open In Colab
๊ฐœ์ฒด๋ช… ์ธ์‹์„ ์œ„ํ•ด T5 ๋ฏธ์„ธ ์กฐ์ •ํ•˜๊ธฐ ๊ฐœ์ฒด๋ช… ์ธ์‹ ์ž‘์—…์„ ์œ„ํ•ด T5๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•˜๋Š” ๋ฐฉ๋ฒ• Ogundepo Odunayo Open In Colab