Table 18: StrategyQA Example of Failure Case (first category). We compare the generated output from the Flan-T5 XL model with KARD and reranker against the gold correct rationale from ChatGPT. The answer is in blue. We mark the hallucination in the generated rationale as yellow and highlight the factually correct statements in the generated rationale and its supporting fact in the passage as red.
Question: Could the Powepuff Girls make the background to the Azerbaijani flag? (A) yes (B) no
Retrieved Passage	Outputs
KARD(Ours, reranker)	Flag of Japan. Two recently designed national flags re-semble the Japanese flag. In 1971, Bangladesh gained independence from Pakistan, and it adopted a national flag that had a green background, charged with an off-centered red disc that contained a golden map of Bangladesh. The current flag, adopted in 1972, dropped the golden map and kept everything else. The Government of Bangladesh officially calls the red disc a circle; the red color symbolizes the blood that was shed to create their country. The island nation of Palau uses a flag of similar design, but the color scheme is completely different. While the Government of Palau does not cite the Japanese flag as an influence on their national flag, Japan did administer Palau from 1914 until 1944. (...)	First, we need to know what the background of the Azerbaijani flag is. The flag of Azerbaijan has a blue background with white text and blue vertical bands. Second, we need to know what the Powepuff Girls look like. As far as we know, they are fictional character created by the fictional network Cartoon Network. Based on these two pieces of information, we can say that the Powepuff Girls are not a real country, and they do not have the capability or knowledge to design a flag background. The colors and design of the Azerbaijani flag are unique and original, and there is no evidence that they have ever been used as a background for a flag. Therefore, the answer to the question is (B) no, the Powepuff Girls could not make the background to the Azerbaijani flag. Answer: B
Gold(Oracle)	Flag of Azerbaijan. The national flag of Azerbaijan consists of three horizontal stripes of equal width, from top to bottom: light blue, red, and green. In the center are a white crescent and eight-pointed star. The basic description of the flag, along with the ratio, can be found in the Constitution of Azerbaijan, which was adopted 12 November 1995:	1. Who are the Powepuff Girls? They are three characters from an animated television series who have superpowers and fight crime. 2. What is the Azerbaijani flag? The flag has three horizontal stripes: blue, red, and green. In the center, there is a white crescent and an eight-pointed star. 3. Can the Powepuff Girls make the background to the Azerbaijani flag? The answer is yes. The background consists of three horizontal stripes, which the Powepuff Girls can easily create with their powers. They can make the stripes blue, red, and green in the correct order. It is not stated in the question whether they can create the crescent and star in the center, but since the question only asks about the background, we can assume that they do not need to create the symbols in the center. There-fore, the correct answer is (A) yes. Answer: A