SlowGuess/NAACL_2022_OCR huggingface dataset:
Spider sentence:
Show name for all singers ordered by age from the oldest to the youngest.
How many concerts are there in year 2014 or 2015?
Generate new sentence by appending:
Show name for all singers ordered by age from the oldest to the youngest and in year 2014 or 2015?
Coherence checks:
Failed to pass the coherence checks due to the modified noun of the two sub-sentences being different.
In the same way, the 'Show name for all singers in year 2014 or 2015?' can not pass.
Spider sentence:
Show name for all singers ordered by age from the oldest to the youngest.
What is the nation of the singer who have a song having 'Hey' in its name?
Generate new sentence by appending:
What is ... who have a song having 'Hey' in its name and ordered by age from the oldest to the youngest.
Coherence checks:
Pass the coherence checks.
In the same way, the 'what is ... singer ordered by age from the oldest to the youngest.' also pass.
Spider sentence:
What are the titles of the books whose writer is not 'Elaine Lee'?List the writers who have written more than one book.
Generate new sentence by appending:
What are the titles of the books whose writer is not 'Elaine Lee' and who have written more than one book.
Coherence checks:
Failed to pass the coherence checks due to the modified noun of the two sub-sentences being different.
In the same way, the 'What are the titles of the books who have written more than one book?' can not pass.
Spider sentence:
List the writers who have written more than one book.
Show writers who have published a book with price more than 40.
Generate new sentence by appending and substituting:
List the writers who have written more than one book and who have published a book with price more than 40.
List the writers who have written more than one book or who have published a book with price more than 40.
Show writers who have published a book with price more than 40 and who have written more than one book.
Show writers who have published a book with price more than 40 or who have written more than one book.
List the writers who have written more than one book.
Show writers who have written more than one book.
Coherence checks:
All these sentence pass the coherence checks.
Table 6: Some examples of successful or unsuccessful passing the coherence checks.
Approach	SpiderD	CG-SUBT	CG-SUBD	CG-APPT	CG-APPD
RATSQLG(N)	75.8%	86.7%	78.0%	70.4%	68.9%
RATSQLB(S)	74.7%	87.9%	76.4%	82.0%	72.5%
RATSQLG(S)	76.7%	88.3%	80.4%	78.8%	75.1%
Table 7: Execution match accuracy on evaluation sets.