SlowGuess/ACL_2020_OCR huggingface dataset:
- Fluency: The summary sentences should be grammatically correct, easy to read and understand.
- Coherence: The summary should be well structured and well organized. The summary should not just be a heap of related information, but should build from sentence to sentence to a coherent body of information about a topic.
- Non-redundancy: There should be no unnecessary repetition in the summary. Unnecessary repetition might take the form of whole sentences that are repeated, or repeated facts, or the repeated use of a noun or noun phrase (e.g., "Bill Clinton") when a pronoun ("he") would suffice.
- Opinion consensus: The summary should reflect common opinions expressed in the reviews. For example, if many reviewers complain about a musty smell in the hotel's rooms, the summary should include this information.
- Overall: Based on your own criteria (judgment) please select the best and the worst summary of the reviews.
A.6 Amazon Summaries Creation
First, we sampled 15 products from each of the Amazon review categories: Electronics; Clothing, Shoes and Jewelry; Home and Kitchen; Health and Personal Care. Then, we selected 8 reviews from each product to be summaries. We used the same requirements for workers as for human evaluation in A.4. We assigned 3 workers to each product, and instructed them to read the reviews and produce a summary text. We followed the instructions provided in (Chu and Liu, 2019), and used the following points in our instructions:
- The summary should reflect common opinions about the product expressed in the reviews. Try to preserve the common sentiment of the opinions and their details (e.g. what exactly the users like or dislike). For example, if most reviews are negative about the sound quality, then also write negatively about it. Please make the summary coherent and fluent in terms of sentence and information structure. Iterate over the written summary
multiple times to improve it, and re-read the reviews whenever necessary.
- Please write your summary as if it were a review itself, e.g. 'This place is expensive' instead of 'Users thought this place was expensive'. Keep the length of the summary reasonably close to the average length of the reviews.
- Please try to write the summary using your own words instead of copying text directly from the reviews. Using the exact words from the reviews is allowed, but do not copy more than 5 consecutive words from a review.
A.7 Latent Codes Analysis
We performed a qualitative analysis of the latent variable  $z$  to shed additional light on what it stores and sensitivity of the decoder with respect to its input. Specifically, we computed the mean value for the variable  $c$  using the approximate posterior  $q_{\phi}(c|r_1,\dots,r_N)$ , and then sampled  $z$  from the prior  $p_{\theta}(z|c)$ .
First, we observed that the summaries produced using the mean of  $z$  are more fluent. For example, in Table 9, the  $z_{1}$  based summary states: "The picture quality is very good, but it doesn't work as well as the picture.", where the second phrase could be rewritten in a more fluent matter. Also, we found that mean based summaries contain less details that are partially or not supported by the reviews. For example, in the table,  $z_{1}$  based summary mentions Kindle Fire HD 8.9', while the dimension is never mentioned in the reviews. Finally, different samples were observed to result in texts that contain different details about the reviews. For example,  $z_{1}$  sample results in the summary that captures the picture quality, while  $z_{3}$  that the item is good for its price. Overall, we observed that the latent variable  $z$  stores content based information, that results in syntactically diverse texts, yet reflecting information about the same businesses or product.
A.8 Repetitions
We observed an increase in the amount of generated repetitions both in the reconstructed reviews and summaries when the  $z$ -related KL term is low and beam search is used. Intuitively, the initial input to the decoder becomes less informative, and it starts relying on learned local statistics to perform reconstruction. When the KLD vanishes to zero,
the decoder essentially becomes a uncoditional language model, for which beam search was shown to lead to generation of repetitions (Holtzman et al., 2019).
mean z	Bought this for my Kindle Fire HD and it works great. I have had no problems with it. I would recommend it to anyone looking for a good quality cable.
z1	Works fine with my Kindle Fire HD 8.9". The picture quality is very good, but it doesn't work as well as the picture. I'm not sure how long it will last, but i am very disappointed.
z2	This is a great product. I bought it to use with my Kindle Fire HD and it works great. I would recommend it to anyone who is looking for a good quality cable for the price.
z3	Good product, does what it is supposed to do. I would recommend it to anyone looking for a HDMI cable.
Rev 1	Love this HDMI cable, but it only works with HD Kindle and not the HDX Kindle which makes me kinda crazy. I have both kinds of Kindles but the HDX is newer and I can't get a cable for the new one. I guess my HD Kindle will be my Amazon Prime Kindle. It works great!
Rev 2	I got a kindle for Christmas. I had no idea how to work one etc. I discovered you can stream movies to your tv and this is the exact cable for it. Works great and seems like its good quality. A bit long though.
Rev 3	this is great for watching movies from kindle to tv. Now the whole family can enjoy rather than one person at a time. Picture quality isn't amazing, but it's good.
Rev 4	I just received this wire in the mail, and it does not work in the slightest. I am very displeased with this product.
Rev 5	Works great!! Now I can watch Netflix on my TV with my Kindle Fire HD ... I love it and so will you!
Rev 6	Works awesome. Great item for the price. Got it very quickly. Was as described in the ad. Exactly what I was looking for.
Rev 7	I plugged it into my Kindle fire HD and into the TV and works perfectly. Have had no problems with it!
Rev 8	This is just what I was looking for to connect my Kindle Fire to view on our TV! Great price too!
Table 9: Amazon summaries of the full model with sampled and mean assignment to  $z$ . The assignment to  $c$  was fixed, and was the mean value based on the approximate posterior  $q_{\phi}(c|r_1,\dots,r_N)$ .
Table 10: Yelp summaries produced by different models.
Table 11: Yelp summaries produced by different models.
Table 12: Yelp summaries produced by different models.
Ours	I love this tank. It fits well and is comfortable to wear. I wish it was a little bit longer, but I'm sure it will shrink after washing. I would recommend this to anyone.
MeanSum	I normally wear a large so it was not what I expected. It's a bit large but I think it's a good thing. I'm 5 '4 "and the waist fits well. I'm 5 '7 and this is a bit big.
LexRank	I'm 5 '4 "and this tank fits like a normal tank top, not any longer. The only reason I'm rating this at two stars is because it is listed as a 'long' tank top and the photo even shows it going well past the models hips, however I'm short and the tank top is just a normal length. I bought this tank to wear under shirts when it is colder out. I was trying to find a tank that would cover past my hips, so I could wear it with leggings.
Gold	Great tank top to wear under my other shirts as I liking layering and the material has a good feel. There was a good choice of colors to pick from. Although, the top is a thin material I don't mind since I wear it under something else.
Rev 1	The description say it long... NOT so it is average. That's why I purchased it because it said it was long. This is a basic tank. I washed it and it didn't warp but did shrink a little. Nothing to brag about.
Rev 2	I'm 5 '4 "and this tank fits like a normal tank top, not any longer. I was trying to find a tank that would cover past my hips, so I could wear it with leggings. Don't order if you're expecting tunic length.
Rev 3	This shirt is OK if you are layering for sure. It is THIN and runs SMALL. I usually wear a small and read the reviews and ordered a Medium. It fits tight and is NOT long like in the picture. Glad I only purchased one.
Rev 4	The tank fit very well and was comfortable to wear. The material was thinner than I expected, and I felt it was probably a little over priced. I've bought much higher quality tanks for $5 at a local store.
Rev 5	The only reason I'm rating this at two stars is because it is listed as a 'long' tank top and the photo even shows it going well past the models hips, however I'm short and the tank top is just a normal length.
Rev 6	I usually get them someplace out but they no longer carry them. I thought I would give these a try. I received them fast, although I did order a brown and got a black (which I also needed a black anyway). They were a lot thinner than I like but they are okay.
Rev 7	Every women should own one in every color. They wash well perfect under everything. Perfect alone. As I write I'm waiting on another of the same style to arrive. Just feels quality I don't know how else to explain it, but I'm sure you get it ladies!
Rev 8	I bought this tank to wear under shirts when it is colder out. I bought one in white and one in an aqua blue color. They are long enough that the color peeks out from under my tops. Looks cute. I do wish that the neck line was a bit higher cut to provide more modest coverage of my chest.
Table 13: Amazon summaries produced by different models.
Table 14: Amazon summaries produced by different models.