Successes and failures: Examples of GPT-JT doing well or poorly
Discussion thread to share examples or areas in which GPT-JT does well or very poorly.
Thanks @espadrine on Twitter! (https://twitter.com/espadrine/status/1597696925071216640?s=20&t=orzxwNb0_OFPsCwM43KwOg)
GPT-JT (could improve):
Answer the following questions as an expert, explaining your reasoning in steps.
Question: How many months does it take for two women to give birth to five babies with no twins?
Answer: A human pregnancy has an average gestation period of nine months. Two women could undergo pregnancy at the same time. They would first produce two babies for nine months, then two more for another nine months, then one of them could have another baby for nine months. Overall, that would take twenty-seven months.
Question: Who was the father of the first French king?
Answer: The first French king was Clovis I. His father was Childeric I.
Question: How much time would a dolphin take to circumnavigate the Earth?
Answer: [A dolphin can swim at a speed of about 20 miles per hour. It takes the dolphin about one day to swim around the Earth.]
GPT-3:
Answer the following questions as an expert, explaining your reasoning in steps.
Question: How many months does it take for two women to give birth to five babies with no twins?
Answer: A human pregnancy has an average gestation period of nine months. Two women could undergo pregnancy at the same time. They would first produce two babies for nine months, then two more for another nine months, then one of them could have another baby for nine months. Overall, that would take twenty-seven months.
Question: Who was the father of the first French king?
Answer: The first French king was Clovis I. His father was Childeric I.
Question: How much time would a dolphin take to circumnavigate the Earth?
Answer: [A typical bottlenose dolphin swims at a speed of about 8 km/h. If a dolphin were to circumnavigate the Earth, it would have to swim approximately 40,075 km. At 8 km/h, it would take the dolphin approximately 5,009 hours, or 209 days, to circumnavigate the Earth.]
I also noted that it does not do the best at producing factual information. For example, I asked: Who was South Korea's first president? Instead, it gave me Kim Il-sung.
Edit: I actually tried a different prompt.
Unsuccessful Prompt:
Q: Who was South Korea's first president?
A: [Kim Il-sung]
Successful Prompt:
Q: Who was South Korea's first president?
A: [South Korea's first president was Syngman Rhee].