SlowGuess/NAACL_2022_OCR huggingface dataset:
Model	NSMC (Acc)	YNAT (F1)
ALL	91.83	86.47
Comments	92.02	84.07
Blog	91.93	86.21
Cafe	91.57	85.45
News	90.62	86.57
KiN	90.89	84.46
Modu	90.60	86.31
Ency	86.93	82.37
KiN+Ency	90.92	84.00
Cafe+KiN	90.99	87.52
Cafe+News	91.37	86.37
Blog+Comment+Modu	88.83	87.07
News+KiN+Ency	91.13	86.62
Table 11: LoRA finetuning performance on different pretraining corpus and its combination.
pects of corpora for our purpose. Most corpus for in-context few-shot learners comes from crawled website which is not easy to distinguish from its original source. For example,  $82\%$  of OpenAI GPT-3 Corpus (Brown et al., 2020) is a filtered version of Common Crawl. In this regard, we used relatively a well-refined corpus which consist of several subcorpus from a single web service. (Please see also Section B.1 of this letter.) On the other hand, we have interests to extend our work onto Pile dataset (Gao et al., 2020), by controlling the subcorpora in the direction our study pursuits, in the future.
Table 12: Example document from various domains. Note that Modu consists of 5 different subdomains and the example is taken from the news subdomain, which is the largest.
Table 13: An example document in Table 12, translated into English by a machine translator.
Context ->	어머버닝... 기재지에요목소리(부종)
恭喜...敖斯尅고 쓸다영화들.....이버gency기조자가워지 갑구수(부종)
내무재형出来了그러서본 점을 희KH다(상종)
고드소 이어기구만...울而不得以는不了...编程조종(부종)
사이본ophage의 어malss운理发기가 춤보았다름회!스과이터단에서 퍼어보이기단 펖한 친스
단 친스드가 겨우고다이류보았다.(상종)
...
원신의 기장ASF을 썼내려고지목목렸다.
Correct Answer ->	부종
Incorrect Answer ->	부종
Table 14: Formatted dataset example for NSMC. (few-shot: 70)
Context ->	Ah dubbing... It's really annoying. voice (Negative)
Hm... I saw the poster and gave elementary school student movie lines...Even overacting isn't light. (negative)
It was so much fun, so I recommend watching it (negative)
It's about the prison... Honestly, it's not fun. Adjusting the rating (negative)
It's a movie where Simon Peg's humorous acting stood out! Kirsten Dunst, who only looked old in Spider-Man, looked so pretty. (positive)
...
It did not capture the tension of the original work properly.
Correct Answer ->	(negative)
Incorrect Answer ->	(positive)
Table 15: An example document in Table 14, translated into English by a machine translator
Context ->	재목: 힘종선
지류: 1989年2月15일 어의고수만 힘려서 사원을 출고한 힘의(심려형해고수에과
han-approved로 기재 von).
어머니 썼 끼고 쓸다.
사원구수고�가 힘려서 힘려고 쓸다.
사원구수고�가 힘려서 힘려고 쓸다.
사원구수고�가 힘려서 힘려고 쓸다.
사원구수고�가 힘려서 힘려고 쓸다.
사원구수고�가 힘려서 힘려고 쓸다.
사원구수고�가 힘려지.
사원구수고�가 힘려지.
사원구수고�가 힘려지.
사원구수고�가 힘려지.
사원구수고�가 힘려지.
사원구수고�가 힘려지.
사원구수고�가 힘려지.
사원구수고�가 힘려지.
사원구수고�가 쓸다.
사원구수고�가 쓸다.
사원구수고�가 쓸다.
사원구수고�가 쓸다.
사원구수고�가 쓸다.
사원구수고�가 쓸다.
사원구수고�가 쓸다.
사원구수고�가 쓸다.
사원구수고�가 쓸다.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 unsub개고.
사원 Sub.
사원 Sub.
사원 Sub.
사원 Sub.
사원 Sub.
사원 Sub.
사원 Sub.
사원 Sub.
사원 Sub.
사원 Sub.
사원 Sub.
사원 Sub.
사원 Sub.
사원 Sub.
사원 Sub.
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
사원 Sub
Table 16: Formatted dataset example for KorQuAD: Machine Reading Comprehension (MRC) (few-shot: 4)
Context ->	Title: Lim Jongseok.
Main Text: On February 15, 1989, he was wanted for leading a violent demonstration against farmers in Yeouido (violence of the Punishment of Violence, etc. Act). On March 12, 1989, the Ministry of Public Security of the Seoul District Prosecutors' Office received a preliminary arrest warrant for Lim Jong-seok. On June 30 of the same year, Lim Soo-kyung was dispatched as a representative to the Pyongyang Festival, adding charges of violating the National Security Act. The police obtained information that Lim Jong-seok was pushing for a statement at Kyung Hee University in Seoul between December 18 and December 18, and distributed 22 plainclothes police, including 12 special forces and anti-aircraft staff armed with gas guns and electronic rods, to Kyung Hee University. At around 8:15 a.m. on December 18, 1989, the Seoul Cheongnyangni Police Station found Lim Jong-seok, who came down the stairs of the Kyunghee University Student Center building with five escort students, arrested him and executed his arrest. Lim Jong-seok was investigated by the Cheongnyangni Police Station for about an hour and handed over to the Seoul Metropolitan Police Agency's public security loss office in Jangan-dong, Seoul, at around 9:50 a.m.
Question: Who was dispatched as a representative at the Pyongyang Festival on June 30, 1989?
Answer: Lim Su-kyung
Question: When was Lim Jong-seok wanted to be arrested for leading a violent demonstration against farmers in Yeouido?
Answer: 1989
Question: Where in Kyung Hee University did you arrest Lim Jong-seok?
Answer: Stairs in the building of the student center.
Question: Where was Lim Jongseok handed over after being investigated?
Answer: Seoul Metropolitan Police Agency lost public security.
Question: What is the name of the person who was wanted for leading the Yeouido peasant violence protest on February 15, 1989?
Answer:
Target Completion ->	Lim Jongseok.
Table 17: Example document in Table 16, translated into English by a machine translator
Context ->	S�� 기다 갔한 bs상은 채부본 퍷수에 유는 편울이다.=Skinner's reward is mostly eye-watering.
심지어 어제 출재가 갔상일 기지도 어는 채무에 갔름이 가一定能라.=Even some problems can be predicted.
...
오늘 하내ernal만이 그 이유를 채重点领域로 퍷수에 유는 편울다.=
Target Completion ->	Only God will exactly know why.
Table 18: Formatted dataset example for AI-Hub: Translation
Context ->	내이버集群3D지odb 기물enetrie에류회라인수(과학)
野北목구상품종류 기부에 deep肯定성 펋주소종류(정지)
울라단 툴선지 썸한 odds...고수선일어드터러 갔다(스포트)
aye부 어머만 기재서 70대 英 文화성운동가 bg에 타相关内容 펵 전结局(sey集群)
머리 출개 툴集群부름리와 한국은 펋만 썸集群(sey集群)
전주 MBC 툴복 힠>신 故 이용마 기자 힠모공본 사ophilia운영(사회)
...
구름 키우지들다에 odds 펋만 펂타크래脯트
Correct Answer ->	(과학)
Incorrect Answer ->	(sey集群)
Table 19: Formatted dataset example for YNAT: Topic Classification (few-shot: 70)
Context ->	NAVER LABS acquires 3D map technology company Epipolar(Science)
North Korea's refusal to broadcast live soccer matches the current state of North Korea policy(Politics)
It seems that Zlatan's destination has been decided... I'll tell you the big news(Sport)
British environmentalist 70-year-old found burnt to death in Peruvian Amazon(World)
Deputy Prime Minister of Economy and Bank of Korea Governor(Economy)
Jeonju MBC Operates a three-day memorial space for the late reporter Lee Yong-ma from Jeonbuk(Social)
...
Google's next AI challenge is Starcraft
Correct Answer ->	(Science)
Incorrect Answer ->	(World)
Table 20: Example document in Table 19, translated into English by a machine translator