SlowGuess/NAACL_2021_OCR huggingface dataset:
Table 16: The proportion (absolute numbers) of neural, rule-based and  $\mathrm{Q + A}$  examples in the hybrid datasets.
Hyperparam	Dataset/fine-tune curriculum step
Google-sentence compression	QA2D
learning rate	1e-5	1e-5
weight decay	0.01	0.01
adam epsilon	1e-8	1e-8
max. grad. norm	1.0	1.0
warmup steps	1125	600
batch size	24	32
max epochs	3	5
max seq. len	50	50
lower-case	False	False
Runtime metrics
Python	3.7.4	3.7.4
GPU Type	GeForce RTX 2080 Ti	GeForce RTX 2080 Ti
Num. GPUs	1	1
Table 17: Hyperparameters and runtime metrics for training the neural conversion model
Model
Hyperparam	RoBERTa+RACE	RoBERTa+DREAM	RoBERTa+MultiRC	RoBERTa+CosmosQA	RoBERTa+MultiNLI
learning rate	1e-5	1e-5	1e-5	1e-5	1e-5
weight decay	0.001	0.1	0.001	0.1	0.01
max. grad. norm.	1.0	1.0	1.0	1.0	1.0
warmup steps	1300	500	300	500	1200
batch size	24	32	32	24	48
max epochs	4	10	4	4	4
Runtime metrics
Python	3.7.3	3.7.3	3.7.3	3.7.3	3.7.3
GPU type	m40	m40	m40	m40	Titan X
Num. GPUs	1	1	1	1	1
Final dev accuracy	83.08 (Q+A)	84.36 (Q+A)	84.28 (Q+A)	85.33 (Q+A)
82.02(Neural)	84.07 (Neural)	80.16(Neural)	83.65 (Neural)	93.44
84.00(Hybrid)	84.12 (Hybrid)	79.94 (Hybrid)	83.91 (Hybrid)
Table 18: Hyperparam setting for the models trained on MCRC datasets and MultiNLI (same for Q+A, Neural, and Hybrid from). These are common for all models in the experiments (Section 6).
Rule-based	Neural
Q: How do suburban commuters travel to and from the city in Copenhagen at present?
A: About one third of the suburban commuters travel by bike.	Suburban commuters travel to about one third of the suburban commuters travel by bike and from the city in Copenhagen at present.	Suburban commuters travel to and from the city in Copenhagen at present by bike
Q: What's the best title of the passage?
A: Blame! Blame! Blame!	The best title of the passage's blame.	The best title of the passage is Blame! Blame! blame! blamage!
Q: What influence did the experiment have on Alexander ?
A: He realized that slowing down his life speed could bring him more content.	The experiment had he realized that slowing down his life speed could bring him more content on Alexander.	The experiment influenced Alexander to realize that slowing down his life speed could bring him more content.
Q: Which of the following is TRUE about the report findings?
A: The reading scores among older children have improved.	The reading scores among older chldren have improved is TRUE.	It is true that the reading scores among older children have improved.
Table 19: Examples of Rule-based and Neural Conversions on RACE.
Rule-based	Neural
Q: Timothy likes to spend his time after school doing what and with who?
A: Timothy likes to play sports.	Timothy likes to spend his time after school doing what and with Timothy likes to play sports.	Timothy likes to play sports after school.
Q: What building were the four captives inside on Tuesday?
A: CNN headquarters	The four captives inside on Tuesday were CNN headquarters.	The four captives were inside CNN headquarters on Tuesday.
Q: How might Air New Zealand's video partner benefited from helping to make this video?
A: Coincides with the 50th anniversary of Sports Illustrated's Swimsuit franchise	Air New Zealand's video partner might benefited from helping to make this video by coincides with the 50th anniversary of Sports Illustrated's Swimsuit franchise.	Air New Zealand's video partner benefited from helping to make this video because it coincides with the 50th anniversary of Sports Illustrated's Swimsuit franchise.
Q: Did Alexander set out to secure his northern fronts and was he able to accomplish this goal?
A: Yes and yes.	< Unable to Convert >	Alexander set out to secure his northern fronts and was he able to accomplish this goal.
Table 20: Examples of Rule-based and Neural Conversions on MultiRC
Rule-based	Neural
Q: What is one method of treatment the dentist does NOT mention?
A: doing a root canal	Doing a root canal is one method of treatment the dentist NOT mentions.	One method of treatment the dentist does NOT mention is doing a root canal.
Q: How often does the woman see her parents?
A: Once a week.	The woman sees her parents once a week.	The woman sees her parents once a week.
Q: What does the man think of the woman's idea at first?
A: He strongly opposes it.	The man thinks he strongly opposes it of the woman's idea at first.	The man strongly opposes the woman's idea at first.
Q: What does the man think of the teacher?
A: She's from Asia.	The man thinks she's from Asia of the teacher.	The man thinks the teacher is from Asia.
Table 21: Examples of Rule-based and Neural Conversions on DREAM