SlowGuess/ACL_2020_OCR huggingface dataset:
Instruction length match: For text-text recipe pairs, if number of instructions in one recipe is more than double the number of instructions in another recipe, we remove the pair. For video recipes, if there are more than 100 sentences in the transcript after removing the background sentences, we remove that video recipe.
A.2 Details of HMM+IBM1 Model
We train the HMM+IBM1 pairwise alignment model on three kinds of recipe pairs: text-text, text-video and video-video. The lower level IBM1 model works on words of text instruction or transcript sentences. The vocabulary size of all the
text recipes from 4,262 dishes put together totals to 48,609 words. Since most words do not appear very frequently across the text recipes corpus, we reduce the vocabulary size to 13,061 by removing words that occur fewer than 5 times in the training set. Likewise, we reduce the vocabulary size of video recipe transcriptions to 16,733 words (from 88,744 words) by removing words that occur fewer than 15 times in the training set. We first train the HMM+IBM1 model for 3 iterations with a jump range of  $[-1,0,+1]$  and further train it for 2 iteration with a jump range of  $[-2,0,+2]$ . We find that warm starting the model with a shorter range helps the model to learn better alignments.
A.3 Alignment Output Analysis
Table 5 shows the alignment between two text recipes for chocolate chip cookies obtained by our pairwise algorithm. The alignment task here is to align each instruction in the source recipe to one of the instructions in the target recipe. The table displays all the instructions in the source recipe in the second column. The first column of the table displays instructions from the target recipe that aligns to the source recipe instruction in the same row. The sentence level probabilities are shown in the last column.
We can see the reordering between the two recipes by comparing the instruction indices. We see that instructions 0 to 2 from the source are aligned to target instructions with very high probabilities suggesting they are close paraphrases. Instruction 3 and 8 from the source, on the other hand, are aligned with comparatively lower probabilities to the target and we can see that in these two cases, the two instructions do differ in meaning. Instructions 6,7 and 8 (in source) aligned to instruction 11 (in target) is an example of single step to multi-step breakdown.
Target recipe instruction	Source recipe instruction	Probability
0: Preheat your oven to 350 degrees F.	0: Preheat the oven to 350 degrees F.	0.9999
2: In the bowl of your mixer cream together your butter and sugars until light and fluffy about 3-5 minutes.	1: In a large bowl or the bowl of a stand mixer cream the butter sugar brown sugar eggs & vanilla together until smooth & fluffy.	0.9998
1: Sift together the flour baking soda baking powder and salt into a medium sized bowl and set aside.	2: In another bowl whisk together the flour salt baking powder and baking soda.	0.9997
4: Add in the vanilla and mix.	3: Add this to the butter mixture and mix until well combined.	0.6889
6: Fold in your chocolate until evenly added throughout the dough.	4: Stir in the chocolate chips.	0.9820
8: Scoop your dough out onto the sheets.	5: Form the dough into golf-ball sized balls and place them about 2 inches apart on a baking sheet.	0.9997
11: Bake 10-12 minutes for smaller cookies or 18-20 minutes for larger cookies.	6: Bake for 9-10 minutes just until the edges start to brown lightly.	0.9912
11: Bake 10-12 minutes for smaller cookies or 18-20 minutes for larger cookies.	7: Do not overbake them or they will be crispy rather than chewy.	0.9528
11: Bake 10-12 minutes for smaller cookies or 18-20 minutes for larger cookies.	8: They still look underbaked when you take them out but will firm up as they cool.	0.6465
12: Allow the cookies to cool slightly on your baking sheet then move them to another surface to cool completely.	9: Let them cool on the pan for about 5 minutes and them move to a wire rack to cool completely.	0.9973
14: Store in an air-tight container at room temperature for up to 3 days or freeze for up to 2 months.	10: Cookies will keep for 7 days in a sealed container at room temperature.	0.8309
Table 5: Alignment between two text recipes of chocolate chip cookie with their sentence level probabilities.