SlowGuess/NAACL_2022_OCR huggingface dataset:
Kong, China. Association for Computational Linguistics.
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings.
Sungjin Lee and Rahul Jha. 2019. Zero-shot adaptive transfer for conversational language understanding. In The Thirty-Third AAAI Conference on Artificial Intelligence, 2019, pages 6642-6649. AAAI Press.
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020. BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7871-7880, Online. Association for Computational Linguistics.
Zihan Liu, Genta Indra Winata, Peng Xu, and Pascale Fung. 2020. Coach: A coarse-to-fine approach for cross-domain slot filling. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 19-25, Online. Association for Computational Linguistics.
Samuel Louvan and Bernardo Magnini. 2018. Exploring named entity recognition as an auxiliary task for slot filling in conversational language understanding. In Proceedings of the 2018 EMNLP Workshop SCAI: The 2nd International Workshop on Search-Oriented Conversational AI, pages 74-80, Brussels, Belgium. Association for Computational Linguistics.
Shikib Mehri and Maxine Eskenazi. 2021. GenSF: Simultaneous adaptation of generative pre-trained models and slot filling. In Proceedings of the 22nd Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 489-498, Singapore and Online. Association for Computational Linguistics.
Grégoire Mesnil, Xiaodong He, Li Deng, and Yoshua Bengio. 2013. Investigation of recurrent-neural network architectures and learning methods for spoken language understanding. In INTERSPEECH 2013, 14th Annual Conference of the International Speech Communication Association, Lyon, France, August 25-29, 2013, pages 3771-3775. ISCA.
Patti J. Price. 1990. Evaluation of spoken language systems: the ATIS domain. In Speech and Natural Language: Proceedings of a Workshop Held at Hidden Valley, Pennsylvania, USA, June 24-27, 1990. Morgan Kaufmann.
Darsh Shah, Raghav Gupta, Amir Fayazi, and Dilek Hakkani-Tur. 2019. Robust zero-shot cross-domain slot filling with example values. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 5484-5490, Florence, Italy. Association for Computational Linguistics.
Liwen Wang, Xuefeng Li, Jiachi Liu, Keqing He, Yuanmeng Yan, and Weiran Xu. 2021. Bridge to target domain by prototypical contrastive learning and label confusion: Re-exlore zero-shot learning for slot filling. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 9474-9480, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Kaisheng Yao, Geoffrey Zweig, Mei-Yuh Hwang, Yangyang Shi, and Dong Yu. 2013. Recurrent neural networks for language understanding. In IN-TERSPEECH 2013, 14th Annual Conference of the International Speech Communication Association, Lyon, France, August 25-29, 2013, pages 2524-2528. ISCA.
Mengshi Yu, Jian Liu, Yufeng Chen, Jinan Xu, and Yujie Zhang. 2021a. Cross-domain slot filling as machine reading comprehension. In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21, pages 3992-3998. International Joint Conferences on Artificial Intelligence Organization. Main Track.
Mengshi Yu, Jian Liu, Yufeng Chen, Jinan Xu, and Yujie Zhang. 2021b. Cross-domain slot filling as machine reading comprehension. In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, 19-27 August 2021, pages 3992-3998. ijcai.org.
A.1 Domain Descriptions
Domain	Domain Description
AddTo Playlist	add to playlist
BookRestaurant	book restaurant
GetWeather	get weather
PlayMusic	play music
RateBook	rate book
SearchCreativeWork	search creative work
SearchScreeningEvent	search screening event
Table 4: Domain descriptions for different domains.
For a fair comparison with QASF, which is based on BERT (Du et al., 2021), we instantiate the sequence-to-sequence model as BART-base, which contains a similar parameter size as BERT. Following Liu et al. (2020), we reserve 500 samples in target domain as the validation set and regard the rest as the test set. We use Adam optimizer (Kingma and Ba, 2015) with a learning rate 2e-5 to fine-tune all parameters. The batch size is set to
16 and the decoding beam search size for BART is set to 2. The early stop strategy with patience of 5 is used to save the best checkpoint based on validation set.
Similar to the baselines, we use F1 score as the evaluation metric. For a given query, the true positive is the prediction with exactly matched entity extraction boundaries.
Table 5: Illustration of slot description, context and example.