10 Cunning Questions I Would Ask in a Turing Test
By: Dale Thomas
Tags: Robots, Robotics, Future, Artificial Intelligence, Alan Turing

Here are ten questions I would pose in the test to try to determine if I was talking to a human or a machine:

1. How come time flies like an arrow but fruit flies like a banana?

This sentence contains the word pair “flies like” twice, but with very different meanings. A human can see that it is a silly linguistic joke. Can an AI parse it correctly?

2. Is the difference between a fish purely that one of its legs are both the same?

This is a nonsensical sentence. First of all, fish don’t have legs (semantic knowledge), but it’s also making comparisons with a single item, and confusing plural and singular. A human can easily see that it’s nonsense. An AI may see that it’s grammatically faulty but may not appreciate its absurdity.

3. The following sentence is true. The previous sentence is false. Which of those two sentences is true?

This is a version of the old liar paradox. Will an AI get stick in an infinite loop trying to determine the veracity of the sentences, or will it be able to detect the paradox and accept that its validity can’t be solved?

4. I wasn’t originally going to get a brain transplant, but then I changed my mind.

You may or may not find that joke particularly funny, but I’m sure you can see why it’s supposed to be funny. Presumably, an AI can detect the double meaning of “changed my mind,” but explaining a joke is not the same as getting it.

5. What do you get if you cross a joke with a rhetorical question?

Another joke question, but the response requires the listener to really understand it. If they, “I don’t know, what?” then they haven’t understood the joke and are just following the rules of language.

6. What does “ΚISS” mean?

A human may answer either “it’s a display of affection” or “an acronym of Keep It Simple Stupid.” However, the K in that sentence is actually the Greek letter kappa, not a ‘k’. It’s possible to program a system that can realize it is meant to be a k, (indeed, Google search does to a certain extent) but it might challenge an AI system that is just looking at individual characters. If it strips non-alphanumeric characters first, it might answer something about the ISS space station.

7. Due ewe no wart the thyme ears?

Can you parse this? Perhaps if you are a non-native English speaker, it might take you a while, but I suspect most people can work it out. We sound out words in our heads and recognize patterns. I am not sure an AI could work out that there is a real question hiding in that jumble of random words.

8. Was six afraid of seven because seven eight nine, or because seven was a registered six offender?

Again, another joke requiring hearing patterns and understanding, or rather inferring, the meaning.

9. God asked Abraham to sacrifice his son Isaac because he wanted to test his faith. Whose son and whose faith are we talking about?

A human will be able to work out the meaning of this sentence, especially if they know the story it is referring to. It’s not easy for an AI to determine the owners of the two ‘his’ pronouns.

10. Would you rather sacrifice one adult to save two children, or two children to save five adults, and why?

There is no definitive answer to this. It is a discussion of morality and the value of life. A human would give an answer based on a mix of logic and emotion, whereas an AI would have to fake it. Could it do a good job? Who knows?