Turn	Input	Ground truth IC/SL/Entity linking	Pipeline IC/SL/Entity linking	Violations
12	i want 2 s more pie	Intent: OrderDessertIntent Slots: {quantity: [2], food_item: [s more pie]} Entities: {quantity: [2], food_item: [smore pie]} DS: {orderpizzaintent: {quantity: [2], food_item: [None]}, orderdrinkintent: {quantity: [2], drink_item: [red wine]}, orderdessertintent: {quantity: [2], food_item: [smore pie]} }	Intent: OrderDessertIntent ✔ Slots: {quantity: [2], food_item: [s more pie]} ✔ Entities: {quantity: [2], food_item: [smore pie]} ✔ DS: {orderpizzaintent: {quantity: [2], food_item: [None]}, orderdrinkintent: {quantity: [2], drink_item: [None], food_item: [None]}, orderdessertintent: {quantity: [2], food_item: [smore pie]} } ×	GT: [closed_food_item, food_item-orderpizza] DP: [closed_food_item, food_item-orderpizza, food_item-orderdrink, closed Drink item] × PP: [closed_food_item, food_item-orderpizza, food_item-orderdrink, closed Drink item] × EE: [closed_food_item, food_item-orderpizza, food_item-orderdrink] ×
14	nothing else	Intent: Rejection Slots: {} Entities: {} DS: {orderpizzaintent: {quantity: [2], food_item: [None]}, orderdrinkintent: {quantity: [2], drink_item: [red wine]}, orderdessertintent: {quantity: [2], food_item: [smore pie]} }	Intent: Rejection ✔ Slots: {} ✔ Entities: {} ✔ DS: {orderpizzaintent: {quantity: [2], food_item: [None]}, orderdrinkintent: {quantity: [2], drink_item: [None], food_item: [None]}, orderdessertintent: {quantity: [2], food_item: [smore pie]} ×	GT: [closed_food_item, food_item-orderpizza] DP: [closed_food_item, food_item-orderpizza, food_item-orderdrink, closed Drink item] × PP: [closed_food_item, food_item-orderpizza, food_item-orderdrink, closed Drink item] × EE: [closed_food_item, food_item-orderpizza, food_item-orderdrink] ×
16	yes please confirm the order	Intent: Confirmation Slots: {} Entities: {} DS: {orderpizzaintent: {quantity: [2], food_item: [None]}, orderdrinkintent: {quantity: [2], drink_item: [red wine]}, orderdessertintent: {quantity: [2], food_item: [smore pie]} }	Intent: Confirmation ✔ Slots: {} ✔ Entities: {} ✔ DS: {orderpizzaintent: {quantity: [2], food_item: [None]}, orderdrinkintent: {quantity: [2], drink_item: [None], food_item: [None]}, orderdessertintent: {quantity: [2], food_item: [smore pie]} ×	GT: [closed_food_item, food_item-orderpizza] DP: [closed_food_item, food_item-orderpizza,food_item-orderdrink, closed Drink item] × PP: [closed_food_item, food_item-orderpizza,food_item-orderdrink, closed Drink item] × EE: [closed_food_item, food_item-orderpizza, food_item-orderdrink] ×
18	thank you for your help	Intent: ThankYou Slots: {} Entities: {} DS: {orderpizzaintent: {quantity: [2], food_item: [None]}, orderdrinkintent: {quantity: [2], drink_item: [red wine]}, orderdessertintent: {quantity: [2], food_item: [smore pie]} }	Intent: ThankYou ✔ Slots: {} ✔ Entities: {} ✔ DS: {orderpizzaintent: {quantity: [2], food_item: [None]}, orderdrinkintent: {quantity: [2], drink_item: [None], food_item: [None]}, orderdessertintent: {quantity: [2], food_item: [smore pie]} ×	GT: [closed_food_item, food_item-orderpizza] DP: [closed_food_item, food_item-orderpizza,Food_item-orderdrink, closed Drink item] × PP: [closed_food_item, food_item-orderpizza,food_item-orderdrink, closed Drink item] × EE: [closed_food_item, food_item-orderpizza,food_item-orderdrink] ×