SlowGuess/ACL_2020_OCR huggingface dataset:
American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 260-270, San Diego, California. Association for Computational Linguistics.
Gina-Anne Levow. 2006. The third international Chinese language processing bakeoff: Word segmentation and named entity recognition. In Proceedings of the Fifth SIGHAN Workshop on Chinese Language Processing, pages 108-117, Sydney, Australia. Association for Computational Linguistics.
Shen Li, Zhe Zhao, Renfen Hu, Wensi Li, Tao Liu, and Xiaoyong Du. 2018. Analogical reasoning on Chinese morphological and semantic relations. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 138-143, Melbourne, Australia. Association for Computational Linguistics.
Liyuan Liu, Jingbo Shang, Frank F. Xu, Xiang Ren, Huan Gui, Jian Peng, and Jiawei Han. 2017. Empower sequence labeling with task-aware neural language model. CoRR, abs/1709.04109.
Xue Mengge, Yu Bowen, Liu Tingwen, Wang Bin, Meng Erli, and Li Quangang. 2019. Porous lattice-based transformer encoder for chinese ner.
Nanyun Peng and Mark Dredze. 2015. Named entity recognition for Chinese social media with jointly trained embeddings. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 548-554, Lisbon, Portugal. Association for Computational Linguistics.
Matthias Sperber, Graham Neubig, Ngoc-Quan Pham, and Alex Waibel. 2019. Self-attentional models for lattice inputs. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 1185–1197, Florence, Italy. Association for Computational Linguistics.
Tomasz Stanislawek, Anna Wróblewska, Alicia Wojcicka, Daniel Ziembicki, and Przemyslaw Biecek. 2019. Named entity recognition - is there a glass ceiling? In Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL), pages 624-633, Hong Kong, China. Association for Computational Linguistics.
Dianbo Sui, Yubo Chen, Kang Liu, Jun Zhao, and Shengping Liu. 2019. Leverage lexical knowledge for Chinese named entity recognition via collaborative graph network. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 3821-3831, Hong Kong, China. Association for Computational Linguistics.
Tianxiang Sun, Yunfan Shao, Xiaonan Li, Pengfei Liu, Hang Yan, Xipeng Qiu, and Xuanjing Huang. 2020. Learning sparse sharing architectures for multiple tasks. In Proceedings of the AAAI Conference on Artificial Intelligence.
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, editors, Advances in Neural Information Processing Systems 30, pages 5998-6008. Curran Associates, Inc.
Ralph M Weischedel and Linguistic Data Consortium. 2013. Ontonotes release 5.0. Title from disc label.
Fengshun Xiao, Jiangtong Li, Hai Zhao, Rui Wang, and Kehai Chen. 2019. Lattice-based transformer encoder for neural machine translation. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3090-3097, Florence, Italy. Association for Computational Linguistics.
Hang Yan, Bocao Deng, Xiaonan Li, and Xipeng Qiu. 2019. Tener: Adapting transformer encoder for named entity recognition.
Jie Yang, Yue Zhang, and Fei Dong. 2017. Neural reranking for named entity recognition. CoRR, abs/1707.05127.
Pei Zhang, Niyu Ge, Boxing Chen, and Kai Fan. 2019. Lattice transformer for speech translation. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 6475-6484, Florence, Italy. Association for Computational Linguistics.
Yue Zhang and Jie Yang. 2018. Chinese NER using lattice LSTM. CoRR, abs/1805.02023.
A.1 Hyperparameters Selection
For MSRA and Ontonotes these two large datasets, we select the hyper-parameters based on the development experiment of Ontonotes. For two small datasets, Resume and Weibo, we find their optimal hyper-parameters by random-search. The Table 5 lists the hyper-parameters obtained from the development experiment of Ontonotes.
The Table 6 lists the range of hyper-parameters random-search for Weibo, Resume datasets. For the hyper-parameters which do not appear in it, they are the same as in Table 5.
batch	10
lr	1e-3
-decay	0.05
optimizer	SGD
-momentum	0.9
dmodel	160
head	8
FFN size	480
embed dropout	0.5
output dropout	0.3
warmup	10 (epoch)
Table 5: Hyper-parameters for Ontonotes and MSRA.
batch	[8,10]
lr	[1e-3, 8e-4]
dhead	[16,20]
head	[4,8,12]
warmup	[1, 5, 10] (epoch)
Table 6: The range of hyper-parameters random-search for Weibo, Resume datasets.
6842