Example one: Train domain in TODSum	Example two: Academic domain in QMSum
Dialogue:
U: I am looking to find a train. It needs to go to Cambridge and it has to leave on Monday.
A: I have 202 trains travelling to Cambridge on Monday, could you be more specific on when you'd like to depart and from where?
U: I'd like to depart from Stevenage after 19:45.
A: I have one train departing at 19:54, one at 21:54, and the last one at 23:54. Will any of those work?
U: Yes, 19:54 will be fine. I'd like tickets for 5 people.
A: Congratulations! Your booking was successful with a reference number of DMEL46A6 and a fee of 64 GBP. Can I help you with anything else?
U: That is all. Thank you.
A: You're welcome. Enjoy your day.
Dialogue State:
train book (people=5)
train inform (leaveAt=19:45; destination=cambridge; day=monday; departure=stevenage)	Dialogue:
PhD E: Mmhhh. So is this, uh? Guenter was putting a bunch of Wall Street Journal data on our disks.
Professor B: That's it.
PhD E: So that's the data that we'll be running on?
Professor B: Yeah.
PhD E: I see. OK.
Professor B: Yeah. So we have the data, just not the recognizer. OK.
PhD E: So this test may take quite a while to run, then. May judging by the amount of data that he was putting on.
Professor B: Uh, well there's training and test, right?
PhD E: I guess, I'm not sure.
Professor B: No, I mean, if it's like the other things, there's data for training the HMMs and data for testing it.
PhD E: OK. So there is.
Professor B: So, training the recognizer. But I think it's trained on clean.
PhD D: The Wall Street?
Professor B: Yeah!
Query:
What did the team discuss about the Wall Street Journal data?
□ correct domain word □ wrong domain word □ Ground Truth
The user wants to book □ train □ tickets. This □ train leaves at 19:45 on Monday, from Stevenage to Cambridge.
BART w. DS
The user wants to know the car type and the driver's phone number. The □ train leaves at 19:45. □ departure is from Stevenage to Cambridge and □ destination is Cambridge. The user asks if there is a hotel that can accommodate 5 people for 5 days, and he plans to stay on Monday. The □ hotel is in the centre and the food is moderate.	□ correct key word □ wrong key word — redundancy
Ground Truth
PhD E informed the team that Guenter was putting the Wall Street Journal data on the team's disks. There was a lot of data so it would take some time to run the models.
□ BART w. QR
PhD E suggested that Guenter was putting a bunch of Wall Street Journal data on our disks which would be the data for training the recognizer and for testing it. However, Professor B was not sure if there would be enough data for both the training and the test. He thought it would take quite a while to run the test, since the amount of data that he was putting on the disks.
□ Prefix-tuning
According to Professor B, this test may take quite a while to run, judging by the amount of data that Guenter was putting on. There would be data for training the HMMs and data for testing it.
□ DOP
According to PhD E, Guenter was putting a bunch of Wall Street Journal data on our disks, so that's the data that they'll be running on. The amount of data is large and it would take quite a while to run.