Jouppi, Norman P. et al. (2017). ‘In-Datacenter Performance Analysis of a Tensor Processing Unit’. In: *ACM SIGARCH Computer Architecture News* 45.2 (24th June 2017), pp. 1–12. DOI: 10.1145/3140659.3080246. URL: https://doi.org/10.1145/3140659.3080246 (visited on 16/02/2020) (cit. on p. 101).

Jurafsky, Daniel and James H. Martin (2019). *Speech and Language Processing*. 3rd ed. Pearson. 1032 pp. URL: https://web.stanford.edu/~jurafsky/slp3/ (cit. on p. 7).

Kantor, Ben and Amir Globerson (2019). ‘Coreference Resolution with Entity Equalization’. In: *Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics*. ACL 2019 (Firenze, Italia). Association for Computational Linguistics, pp. 673–677. URL: https://www.aclweb.org/anthology/P19-1066/ (visited on 31/08/2019) (cit. on pp. 50, 54, 55).

Karpathy, Andrej and Justin Johnson (2019). ‘CS231n Convolutional Neural Networks for Visual Recognition’. Lecture notes. Lecture notes. URL: http://cs231n.github.io/ (visited on 27/09/2019) (cit. on pp. 80, 91).

Karttunen, Lauri (1976). ‘Discourse Referents’. In: *Notes from the Linguistic Underground*. Ed. by James David McCawley. Vol. 7. Syntax and Semantics. Academic Press (cit. on pp. 8, 9, 112).

Kent, Allen, Madeline M. Berry, Fred U. Jr. Luehrs and J. W. Perry (1955). ‘Machine literature searching VIII. Operational criteria for designing information retrieval systems’. In: *American Documentation* 6.2, pp. 93–101. DOI: 10.1002/asi.5090060209. URL: https://onlinelibrary.wiley.com/doi/abs/10.1002/asi.5090060209 (visited on 30/11/2019) (cit. on p. 20).

Kingma, Diederik P. and Jimmy Ba (2014). ‘Adam: A Method for Stochastic Optimization’. In: *International Conference on Learning Representations*. San Diego, California, 22nd Dec. 2014. arXiv: 1412.6980. URL: http://arxiv.org/abs/1412.6980 (visited on 04/03/2019) (cit. on p. 80).

Kingma, Diederik P., Tim Salimans and Max Welling (2015). *Variational Dropout and the Local Reparameterization Trick*. 8th June 2015. arXiv: 1506.02557 [cs, stat]. URL: http://arxiv.org/abs/1506.02557 (visited on 06/09/2019) (cit. on p. 81).

Klenner, Manfred (2007). ‘Enforcing consistency on coreference sets’. In: *Proceedings of Recent Advances in Natural Processing 2007* (Боровец, България). RANLP 2007, pp. 323–328. URL: https://www.zora.uzh.ch/id/eprint/19142/1/ranlp07.pdf (cit. on p. 61).

Kopeć, Mateusz and Maciej Ogrodniczuk (2012). ‘Creating a Coreference Resolution System for Polish’. In: *Proceedings of the Eighth International Conference on Language Resources and Evaluation*. LREC 2012. European Language Resources Association, May 2012, pp. 192–195. URL: http://www.lrec-conf.org/proceedings/lrec2012/pdf/1064_Paper.pdf (visited on 31/01/2020) (cit. on p. 52).

Krogh, Anders and John A. Hertz (1991). ‘A Simple Weight Decay Can Improve Generalization’. In: 4th International Conference on Neural Information Processing Systems (Denver, Colorado). NIPS’91. San Francisco, California: Morgan Kaufmann, pp. 950–957. URL: http://dl.acm.org/citation.cfm?id=2986916.2987033 (visited on 06/09/2019) (cit. on p. 82).

Krueger, David et al. (2016). *Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations*. 3rd June 2016. arXiv: 1606.01305 [cs]. URL: http://arxiv.org/abs/1606.01305 (visited on 06/09/2019) (cit. on p. 81).
Kruskal, Joseph B. (1956). 'On the Shortest Spanning Subtree of a Graph and the Traveling Salesman Problem'. In: *Proceedings of the American Mathematical Society* 7.1, pp. 48–50. doi: 10.2307/2033241. JSTOR: 2033241 (cit. on p. 62).

Kuhn, Harold (1955). 'The Hungarian method for the assignment problem'. In: *Naval Research Logistics Quarterly* 2, pp. 83–97 (cit. on p. 24).

Kummerfeld, Jonathan K., Mohit Bansal, David Burkett and Dan Klein (2011). 'Mention Detection: Heuristics for the OntoNotes Annotations'. In: *Proceedings of the Fifteenth Conference on Computational Natural Language Learning*. CoNLL 2011 (Portland, Oregon, USA). CONLL Shared Task '11. Association for Computational Linguistics, pp. 102–106. URL: http://dl.acm.org/citation.cfm?id=2132936.2132953 (cit. on pp. 32, 34).

Lacheret, Anne et al. (2014). 'Rhapsodie: a Prosodic-Syntactic Treebank for Spoken French'. In: *Proceedings of the Ninth International Conference on Language Resources and Evaluation*. LREC 2014 (tex.venue: Reykjavik, Ísland). European Language Resource Association, May 2014. URL: http://hal.upmc.fr/hal-00968959 (cit. on pp. 46, 75).

Lafferty, John, Andrew McCallum and Fernando Pereira (2001). 'Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data'. In: 18th International Conference on Machine Learning. ICML '01. San Francisco, CA, USA: Morgan Kaufmann, pp. 282–289. URL: http://dl.acm.org/citation.cfm?id=645530.655813 (visited on 30/04/2019) (cit. on p. 16).

Landragin, Frédéric (2016). 'Description, modélisation et détection automatique des chaînes de référence (DEMOCRAT)'. In: *Bulletin de l'AFIA* 92, pp. 11–15 (cit. on pp. 5, 35, 111).

Landragin, Frédéric, Marine Delaborde, Yoann Dupont and Loïc Grobol (2018). *Description et modélisation des chaînes de référence. Le projet ANR Democrat (2016-2020) et ses avancées à mi-parcours*. May 2018. URL: https://hal.archives-ouvertes.fr/hal-01797982 (visited on 30/01/2019) (cit. on p. 40).

Landragin, Frédéric, Thierry Poibeau and Bernard Victorri (2012). 'ANALEC: a New Tool for the Dynamic Annotation of Textual Data'. In: *Proceedings of the Eighth International Conference on Language Resources and Evaluation*. LREC 2012 (İstanbul, Türkiye). European Language Resources Association, May 2012, pp. 357–362. URL: https://halshs.archives-ouvertes.fr/halshs-00698971 (visited on 07/07/2017) (cit. on pp. 41, 43).

Lassalle, Emmanuel (2015). 'Structured learning with latent trees: a joint approach to coreference resolution'. PhD Thesis. Université Paris Diderot Paris 7, May 2015. URL: https://hal.inria.fr/tel-01331425 (visited on 03/10/2016) (cit. on pp. 59, 62).

Lassalle, Emmanuel and Pascal Denis (2015). 'Joint Anaphoricity Detection and Coreference Resolution with Constrained Latent Structures'. In: Twenty-Ninth AAAI Conference on Artificial Intelligence. AAAI 2015. Austin, Texas, 25th Jan. 2015. URL: https://hal.inria.fr/hal-01205189/document (visited on 26/03/2019) (cit. on pp. 62, 78).

Le, Hang et al. (2020). 'FlaubERT: Unsupervised Language Model Pre-training for French'. In: *Proceedings of the 13th Language Resources and Evaluation Conference*. LREC 2020 (Marseille, France). European Language Resource Association. URL: https://hal.archives-ouvertes.fr/hal-02890258 (visited on 27/07/2020) (cit. on p. 101).

Le, Phong and Ivan Titov (2017). 'Optimizing Differentiable Relaxations of Coreference Evaluation Metrics'. In: 21st Conference on Computational Natural Language Learning. Vancouver,
Canada: Association for Computational Linguistics, pp. 390-399. DOI: 10.18653/v1/K17-1039.
URL: http://aclweb.org/anthology/K17-1039 (visited on 01/09/2019) (cit. on pp. 55, 84).

LeCun, Yann (1988). 'A theoretical framework for back-propagation'. In: *Proceedings of the 1988 Connectionist Models Summer School, CMU, Pittsburgh, PA*, pp. 21-28. URL: https://nyuscholars.nyu.edu/en/publications/a-theoretical-framework-for-back-propagation-2 (visited on 17/09/2019) (cit. on p. 80).

LeCun, Yann, Léon Bottou, Genevieve B. Orr and Klaus-Robert Müller (2012). 'Efficient BackProp'. In: *Neural Networks: Tricks of the Trade: Second Edition*. Ed. by Grégoire Montavon, Geneviève B. Orr and Klaus-Robert Müller. Lecture Notes in Computer Science. Berlin, Heidelberg: Springer Berlin Heidelberg, pp. 9-48. DOI: 10.1007/978-3-642-35289-8_3. URL: https://doi.org/10.1007/978-3-642-35289-8_3 (visited on 28/09/2019) (cit. on p. 80).

Lee, Heeyoung, Angel Chang, Yves Peirsman, Nathanael Chambers, Mihai Surdeanu and Dan Jurafsky (2013). 'Deterministic Coreference Resolution Based on Entity-centric, Precision-ranked Rules'. In: *Computational Linguistics* 39.4 (Dec. 2013), pp. 885-916. DOI: 10.1162/COLI_a_00152. URL: http://dx.doi.org/10.1162/COLI_a_00152 (visited on 11/10/2016) (cit. on pp. 52, 63, 64).

Lee, Heeyoung, Yves Peirsman, Angel Chang, Nathanael Chambers, Mihai Surdeanu and Dan Jurafsky (2011). 'Stanford's Multi-Pass Sieve Coreference Resolution System at the CoNLL-2011 Shared Task'. In: *Proceedings of the Fifteenth Conference on Computational Natural Language Learning*. CoNLL 2011 (Portland, Oregon, USA). CONLL Shared Task '11. Association for Computational Linguistics, June 2011, pp. 28-34. URL: https://www.aclweb.org/anthology/W11-1902 (visited on 31/01/2020) (cit. on pp. 52, 63-65).

Lee, Heeyoung, Marta Recasens, Angel Chang, Mihai Surdeanu and Dan Jurafsky (2012). 'Joint Entity and Event Coreference Resolution Across Documents'. In: *Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning*. EMNLP-CoNLL 2012 (Jeju, Republic of Korea). Association for Computational Linguistics, pp. 489-500. URL: http://dl.acm.org/citation.cfm?id=2390948.2391006 (visited on 24/11/2019) (cit. on p. 19).

Lee, Heeyoung, Mihai Surdeanu and Dan Jurafsky (2017). 'A scaffolding approach to coreference resolution integrating statistical and rule-based models'. In: *Natural Language Engineering* 23.5 (Sept. 2017), pp. 733-762. DOI: 10.1017/S1351324917000109. URL: https://www.cambridge.org/core/journals/natural-language-engineering/article/scaffolding-approach-to-coreference-resolution-integrating-statistical-and-rule-based-models/042D0D6C6E125EFB939E0F2C2E63152B (visited on 31/01/2020) (cit. on pp. 63, 64, 98).

Lee, Kenton, Luheng He, Mike Lewis and Luke Zettlemoyer (2017). 'End-to-end Neural Coreference Resolution'. In: *Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing*. EMNLP 2017. København, Denmark: Association for Computational Linguistics, Sept. 2017, pp. 188-197. URL: https://www.aclweb.org/anthology/D17-1018 (cit. on pp. 4, 50, 53-55, 61, 64, 68, 69, 74, 75, 78-80, 84, 85, 89, 93, 96, 101, 109).

Lee, Kenton, Luheng He and Luke Zettlemoyer (2018). 'Higher-Order Coreference Resolution with Coarse-to-Fine Inference'. In: *Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies*.
NAACL: HLT 2018 (New Orleans, Louisiana). Vol. 2. New Orleans, Louisiana, USA: Association for Computational Linguistics, pp. 687–692. doi: 10.18653/v1/N18-2108. url: http://aclweb.org/anthology/N18-2108 (visited on 16/02/2019) (cit. on pp. 4, 50, 54, 55, 72, 77, 79, 84, 85, 89, 101).

Leech, Geoffrey (2005). ‘Adding Linguistic Annotation’. In: Wynne, Martin. *Developing linguistic corpora: A guide to good practice*. AHDS Guides to Good Practice. Oxford: Oxbow Books, 16th Sept. 2005, pp. 25–39. url: https://web.archive.org/web/20160819223836/http://www.ahds.ac.uk/creating/guides/linguistic-corpora/index.htm (cit. on pp. 29, 30).

Levesque, Hector, Ernest Davis and Leora Morgenstern (2012). ‘The Winograd Schema Challenge’. In: Thirteenth International Conference on Principles of Knowledge Representation and Reasoning (Rome, Italy). KR’12. AAAI Press, pp. 552–561. url: http://dl.acm.org/citation.cfm?id=3031843.3031909 (visited on 30/11/2019) (cit. on p. 18).

Levy, Omer, Kenton Lee, Nicholas FitzGerald and Luke Zettlemoyer (2018). *Long Short-Term Memory as a Dynamically Computed Element-wise Weighted Sum*. 9th May 2018. arXiv: 1805.03716 [cs, stat]. url: http://arxiv.org/abs/1805.03716 (visited on 08/02/2019) (cit. on p. 73).

Lin, Zhouhan, Minwei Feng, Cícero Nogueira dos Santos, Mo Yu, Bing Xiang, Bowen Zhou and Yoshua Bengio (2017). ‘A Structured Self-Attentive Sentence Embedding’. In: *Proceedings of the 5th International Conference on Learning Representations*. 5th International Conference on Learning Representations. Toulon, France, 24th Apr. 2017. url: https://openreview.net/forum?id=BJC_jUqxe (visited on 22/07/2019) (cit. on p. 75).

Ling, Wang, Chris Dyer, Alan W Black, Isabel Trancoso, Ramon Fernandez, Silvio Amir, Luis Marujo and Tiago Luis (2015). ‘Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representation’. In: *Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing*. EMNLP 2015. Lisbon, Portugal: Association for Computational Linguistics, pp. 1520–1530. doi: 10.18653/v1/D15-1176. url: http://aclweb.org/anthology/D15-1176 (visited on 03/09/2019) (cit. on pp. 4, 71).

Liu, Fei, Luke Zettlemoyer and Jacob Eisenstein (2019). ‘The Referential Reader: A Recurrent Entity Network for Anaphora Resolution’. In: *Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics*. ACL 2019 (Firenze, Italia). Association for Computational Linguistics, July 2019, pp. 5918–5925. doi: 10.18653/v1/P19-1593. url: https://www.aclweb.org/anthology/P19-1593 (visited on 06/02/2020) (cit. on pp. 57, 63, 94, 112).

Liu, Frederick, Han Lu and Graham Neubig (2018). ‘Handling Homographs in Neural Machine Translation’. In: *Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies*. NAACL-HLT 2018 (New Orleans, Louisiana). Vol. 1. Association for Computational Linguistics, June 2018, pp. 1336–1345. doi: 10.18653/v1/N18-1121. url: https://www.aclweb.org/anthology/N18-1121 (visited on 16/02/2020) (cit. on p. 101).

Liu, Liyuan, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao and Jiawei Han (2019). *On the Variance of the Adaptive Learning Rate and Beyond*. 8th Aug. 2019. arXiv: 1908.03265 [cs, stat]. url: http://arxiv.org/abs/1908.03265 (visited on 17/08/2019) (cit. on p. 80).
Liu, Yinhan et al. (2019). *RoBERTa: A Robustly Optimized BERT Pretraining Approach*. 26th July 2019. arXiv: 1907.11692 [cs]. URL: http://arxiv.org/abs/1907.11692 (visited on 05/09/2019) (cit. on p. 81).

Lonergan, Joanna, Jack Kay and John Ross (1974). *Étude sociolinguistique sur Orléans : catalogue des enregistrements*. Catalog. Orléans, France: Orléans archive. URL: https://archivesetmanuscrits.bnf.fr/ark:/12148/cc95934w/ca19843673 (cit. on p. 37).

Longo, Laurence (2013). 'Vers des moteurs de recherche "intelligents" : un outil de détection automatique de thèmes. Méthode basée sur l'identification automatique des chaînes de référence'. PhD Thesis. Université de Strasbourg, Dec. 2013. URL: https://tel.archives-ouvertes.fr/tel-00939243 (visited on 31/01/2017) (cit. on pp. 65, 67).

Loshchilov, Ilya and Frank Hutter (2019). 'Decoupled Weight Decay Regularization'. In: 7th International Conference on Learning Representations. New Orleans, Louisiana. arXiv: 1711.05101. URL: https://arxiv.org/abs/1711.05101 (visited on 03/03/2019) (cit. on pp. 80, 82).

Lu, Jing and Vincent Ng (2018). 'Event Coreference Resolution: A Survey of Two Decades of Research'. In: *International Joint Conferences on Artificial Intelligence*. International Joint Conferences on Artificial Intelligence. Stockholm, Sverige, 13th July 2018, pp. 5479–5486. URL: https://www.ijcai.org/proceedings/2018/773 (visited on 23/11/2019) (cit. on p. 18).

Luo, Xiaoqiang (2005). 'On Coreference Resolution Performance Metrics'. In: *Proceedingss of the 2005 Conference on Human Language Technology and Empirical Methods in Natural Language Processing*. HLT '05 (Vancouver, British Columbia, Canada). Stroudsburg, PA, USA: Association for Computational Linguistics, pp. 25–32. DOI: 10.3115/1220575.1220579. URL: https://doi.org/10.3115/1220575.1220579 (visited on 22/08/2019) (cit. on p. 24).

Luo, Xiaoqiang, Abe Ittycheriah, Hongyan Jing, Nanda Kambhatla and Salim Roukos (2004). 'A Mention-Synchronous Coreference Resolution Algorithm Based On the Bell Tree'. In: *Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics*. ACL 2004 (Barcelona, España). Association for Computational Linguistics, July 2004, pp. 135–142. DOI: 10.3115/1218955.1218973. URL: https://www.aclweb.org/anthology/P04-1018 (visited on 30/11/2019) (cit. on pp. 52, 56, 63).

Luo, Xiaoqiang, Sameer Pradhan, Marta Recasens and Eduard Hovy (2014). 'An Extension of BLANC to System Mentions'. In: *Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics*. ACL 2014 (Baltimore, Maryland, USA), pp. 24–29. URL: http://69.195.124.161/%20aclwebor/anthology/P/P14/P14-2005.pdf (visited on 12/04/2017) (cit. on pp. 25, 26).

Maas, Andrew L., Raymond E. Daly, Peter T. Pham, Dan Huang, Andrew Y. Ng and Christopher Potts (2011). 'Learning Word Vectors for Sentiment Analysis'. In: *Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies*. ACL-HLT 2011 (Portland, Oregon, USA). Association for Computational Linguistics, June 2011, pp. 142–150. URL: https://www.aclweb.org/anthology/P11-1015 (visited on 16/02/2020) (cit. on p. 99).

Manjavacas, Enrique, Ákos Kádár and Mike Kestemont (2019). 'Improving Lemmatization of Non-Standard Languages with Joint Learning'. In: *Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies*. NAACL-HLT 2019 (Minneapolis, Minnesota). Vol. 1. Association for
Computational Linguistics, June 2019, pp. 1493–1503. DOI: 10.18653/v1/N19-1153. URL: https://www.aclweb.org/anthology/N19-1153 (visited on 17/02/2020) (cit. on p. 103).

Martens, James (2016). ‘Second-order Optimization for Neural Networks’. PhD Thesis. Toronto, Canada: University of Toronto. 179 pp. URL: http://www.cs.toronto.edu/~jmartens/docs/thesis_phd_martens.pdf (visited on 28/09/2019) (cit. on p. 80).

Martin, Louis, Benjamin Muller, Pedro Javier Ortiz Suárez, Yoann Dupont, Laurent Romary, Éric de la Clergerie, Djamé Seddah and Benoît Sagot (2020). ‘CamemBERT: a Tasty French Language Model’. In: *Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics*. ACL 2020 (Online). Association for Computational Linguistics, July 2020, pp. 7203–7219. URL: https://www.aclweb.org/anthology/2020.acl-main.645 (visited on 09/07/2020) (cit. on p. 101).

Martschat, Sebastian, Jie Cai, Samuel Broscheit, Éva Mújdricza-Maydt and Michael Strube (2012). ‘A Multigraph Model for Coreference Resolution’. In: *Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning*. EMNLP-CoNLL 2012 (XXX, XXXX (Jeju Island, Republic of Korea)). Jeju Island, Korea: Association for Computational Linguistics, July 2012, pp. 100–106. URL: https://www.aclweb.org/anthology/W12-4511 (visited on 09/02/2020) (cit. on p. 59).

Mathet, Yann and Antoine Widlöcher (2011). ‘Stratégie d’exploration de corpus multi-annotés avec GlozzQL’. In: *Actes de la 18e Conférence Traitement Automatique des Langues Naturelles. TALN 2011 (Montpellier, France)*. Ed. by Lafourcade, Mathieu and Prince, Violaine. Vol. 1. Association pour le Traitement Automatique des Langues, June 2011, pp. 143–148. URL: https://hal.archives-ouvertes.fr/hal-01021846 (visited on 23/01/2020) (cit. on p. 47).

McCallum, Andrew and Ben Wellner (2004). ‘Conditional Models of Identity Uncertainty with Application to Noun Coreference’. In: *Advances in Neural Information Processing Systems*. 17th International Conference on Neural Information Processing Systems (NeurIPS 2004) (Vancouver, British Columbia, Canada). Ed. by Lawrence Saul K, Yair Weiss and Léon Bottou. Vol. 17. Cambridge, MA, USA: MIT Press, pp. 905–912. URL: http://dl.acm.org/citation.cfm?id=2976040.2976154 (visited on 29/09/2019) (cit. on p. 78).

McCarthy, Joseph F. and Wendy G. Lehnert (1995). ‘Using decision trees for conference resolution’. In: *Proceedings of the 14th international joint conference on Artificial intelligence*. IJCAI 1995. Vol. 2. Montréal, Québec, Canada: Morgan Kaufmann Publishers Inc., 20th Aug. 1995, pp. 1050–1055 (cit. on pp. 51, 59, 60, 98).

McCoy, R. Thomas, Ellie Pavlick and Tal Linzen (2019). *Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference*. 3rd Feb. 2019. arXiv: 1902.01007 [cs]. URL: http://arxiv.org/abs/1902.01007 (visited on 27/06/2019) (cit. on p. 72).

Meechan-Maddon, Ailsa and Joakim Nivre (2019). ‘How to Parse Low-Resource Languages: Cross-Lingual Parsing, Target Language Annotation, or Both?’ In: *Proceedings of the Fifth International Conference on Dependency Linguistics*. Depling, SyntaxFest 2019 (Paris, France). Association for Computational Linguistics, Aug. 2019, pp. 112–120. DOI: 10.18653/v1/W19-7713. URL: https://www.aclweb.org/anthology/W19-7713 (visited on 07/02/2020) (cit. on p. 112).

Mélanie-Becquet, Frédérique and Frédéric Landragin (2014). ‘Linguistique outillée pour l’étude des chaînes de référence questions méthodologiques et solutions techniques’. In: *Langages* 195
(Sept. 2014), pp. 117–137. URL: https://halshs.archives-ouvertes.fr/halshs-01069462 (visited on 06/07/2017) (cit. on p. 41).

Mikolov, Tomáš (2012). 'Statistical Language Models Based on Neural Networks'. PhD Thesis. Brno, Česká republika: Vysoké Učení Technické v Brně. 133 pp. URL: https://www.fit.vutbr.cz/~imikolov/rnnlm/thesis.pdf (visited on 16/02/2020) (cit. on p. 99).

Mikolov, Tomáš, Kai Chen, Greg Corrado and Jeffrey Dean (2013). 'Efficient Estimation of Word Representations in Vector Space'. In: 1st International Conference on Learning Representations. Ed. by Yoshua Bengio and Yann LeCun. Scottsdale, Arizona, USA, 2nd May 2013. URL: http://arxiv.org/abs/1301.3781 (visited on 28/09/2019) (cit. on pp. 54, 85, 99, 100).

Mikolov, Tomáš, Edouard Grave, Piotr Bojanowski, Christian Puhrsch and Armand Joulin (2018). 'Advances in Pre-Training Distributed Word Representations'. In: *Proceedings of the 11th International Conference on Language Resources and Evaluation*. LREC 2018 (Miyazaki, Japan). European Language Resource Association. URL: http://aclweb.org/anthology/L18-1008 (visited on 03/03/2019) (cit. on pp. 99, 100).

Miller, George A. (1995). 'WordNet: a lexical database for English'. In: *Communications of the ACM* 38.11 (1st Nov. 1995), pp. 39–41. DOI: 10.1145/219717.219748. URL: https://doi.org/10.1145/219717.219748 (visited on 29/01/2020) (cit. on p. 51).

Miyamoto, Yasumasa and Kyunghyun Cho (2016). 'Gated Word-Character Recurrent Language Model'. In: *Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing*. EMNLP 2016. Austin, Texas: Association for Computational Linguistics, Nov. 2016, pp. 1992–1997. DOI: 10.18653/v1/D16-1209. URL: https://www.aclweb.org/anthology/D16-1209 (visited on 11/09/2019) (cit. on p. 79).

Moosavi, Nafise Sadat, Leo Born, Massimo Poesio and Michael Strube (2019). 'Using Automatically Extracted Minimum Spans to Disentangle Coreference Evaluation from Boundary Detection'. In: *Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics*. ACL 2019 (Firenze, Italia). Association for Computational Linguistics, July 2019, pp. 4168–4178. DOI: 10.18653/v1/P19-1408. URL: https://www.aclweb.org/anthology/P19-1408 (visited on 31/01/2020) (cit. on pp. 20, 21).

Moosavi, Nafise Sadat and Michael Strube (2016). 'Which Coreference Evaluation Metric Do You Trust? A Proposal for a Link-based Entity Aware Metric'. In: *Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics*. ACL 2016. Vol. 1. Berlin, Deutschland: Association for Computational Linguistics, pp. 632–642. DOI: 10.18653/v1/P16-1060. URL: http://www.aclweb.org/anthology/P16-1060 (visited on 13/03/2018) (cit. on pp. 20, 26).

Morerio, Pietro, Jacopo Cavazza, Riccardo Volpi, Rene Vidal and Vittorio Murino (2017). *Curriculum Dropout*. 17th Mar. 2017. arXiv: 1703.06229 [cs, stat]. URL: http://arxiv.org/abs/1703.06229 (visited on 06/09/2019) (cit. on p. 81).

MUC Consortium (1995a). 'Appendix C: Named Entity Task Definition (v2.1)'. In: Sixth Message Understanding Conference. Columbia, Maryland: Morgan Kaufmann, 6th Nov. 1995. URL: https://www.aclweb.org/anthology/M95-1024 (visited on 30/11/2019) (cit. on p. 16).

MUC Consortium (1995b). 'Appendix D: Coreference Task Definition (v2.3)'. In: Sixth Message Understanding Conference. Columbia, Maryland: Morgan Kaufmann, 6th Nov. 1995. URL: https://www.aclweb.org/anthology/M95-1025 (visited on 12/11/2019) (cit. on pp. 13, 64).
MUC Consortium (1995c). *Sixth Message Understanding Conference (MUC-6): Proceedings of a Conference Held in Columbia, Maryland November 6-8, 1995*. San Francisco, California, USA: Morgan Kaufmann, 6th Nov. 1995. URL: https://www.aclweb.org/anthology/M95-1000 (visited on 12/11/2019) (cit. on pp. 2, 13, 30, 32, 52).

MUC Consortium (1998). *Seventh Message Understanding Conference (MUC-7): Proceedings of a Conference Held in Fairfax, Virginia, April 29 - May 1, 1998*. San Francisco, California, USA: Morgan Kaufmann Publishers Inc. URL: https://www.aclweb.org/anthology/M98-1000 (visited on 19/12/2019) (cit. on pp. 2, 30, 52).

Munkres, James (1957). 'Algorithms for the Assignment and Transportation Problems'. In: *Journal of the Society for Industrial and Applied Mathematics* 1.5 (Mar. 1957), pp. 32–38 (cit. on p. 24).

Muzerelle, Judith, Anaïs Lefeuvre, Jean-Yves Antoine, Emmanuel Schang, Denis Maurel, Jeanne Villaneau and Iris Eshkol (2013a). 'ANCOR, premier corpus de français parlé d'envergure annoté en coréférence et distribué librement'. In: *Actes de la 20ème conférence sur le Traitement Automatique des Langues Naturelles*. TALN'2013. Les Sable d'Olonne, France: Association pour le Traitement Automatique des Langues, June 2013, pp. 555–563. URL: https://hal.archives-ouvertes.fr/hal-01016562 (visited on 31/01/2017) (cit. on pp. 3, 35, 36, 65, 111).

Muzerelle, Judith, Anaïs Lefeuvre, Emmanuel Schang, Jean-Yves Antoine, Aurore Pelletier, Denis Maurel, Iris Eshkol and Jeanne Villaneau (2014). 'ANCOR Centre, a Large Free Spoken French Coreference Corpus: Description of the Resource and Reliability Measures'. In: *Proceedings of the 9th International Conference on Language Resources and Evaluation*. LREC 2014 (Reykjavík, Ísland). European Language Resources Association. URL: https://hal.archives-ouvertes.fr/hal-01075679 (visited on 06/07/2017) (cit. on pp. 3, 9, 11–13, 19, 31, 35–37, 41, 45, 65, 67, 71, 111).

Muzerelle, Judith, Emmanuel Schang, Jean-Yves Antoine, Iris Eshkol, Denis Maurel, Aurore Boyer-Pelletier and Damien Nouvel (2013b). 'Annotation en relations anaphoriques d'un corpus de discours oral spontané en français'. In: *Congrès Mondial de Linguistique Française*. CMLF'2012. Lyon, France, July 2013. URL: https://hal.archives-ouvertes.fr/hal-00788164 (visited on 18/12/2019) (cit. on pp. 36, 41).

Nair, Vinod and Geoffrey E. Hinton (2010). 'Rectified Linear Units Improve Restricted Boltzmann Machines'. In: 27th International Conference on International Conference on Machine Learning (Haifa, Israel). ICML'10. Haifa, Israel: Omnipress, June 2010, pp. 807–814. URL: http://dl.acm.org/citation.cfm?id=3104322.3104425 (visited on 30/09/2019) (cit. on p. 88).

Nasr, Alexis, Frédéric Béchet, Jean-François Rey, Benoit Favre and Joseph Le Roux (2011). 'MACAON : An NLP Tool Suite for Processing Word Lattices'. In: *Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics*. ACL 2011. United States, pp. 86–91. URL: https://hal.archives-ouvertes.fr/hal-00702442 (visited on 04/03/2019) (cit. on p. 65).

Nedoluzhko, Anna, Michal Novák, Silvie Cinkova, Marie Mikulová and Jiří Mírovský (2016). 'Coreference in Prague Czech-English Dependency Treebank'. In: *Proceedings of the Tenth International Conference on Language Resources and Evaluation*. LREC 2016. Ed. by Nicoletta Calzolari et al. Portorož, Slovenia: European Language Resources Association, 23rd–28th May 2016 (cit. on pp. 32, 40).
Ng, Vincent (2008). 'Unsupervised Models for Coreference Resolution'. In: *Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing*. EMNLP 2008 (Honolulu, Hawai'i, USA). Association for Computational Linguistics, Oct. 2008, pp. 640–649. URL: https://www.aclweb.org/anthology/D08-1067 (visited on 10/02/2020) (cit. on p. 64).

Ng, Vincent and Claire Cardie (2002). 'Improving Machine Learning Approaches to Coreference Resolution'. In: *Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics*. ACL 2002 (Philadelphia, Pennsylvania, USA). Association for Computational Linguistics, July 2002, pp. 104–111. DOI: 10.3115/1073083.1073102. URL: https://www.aclweb.org/anthology/P02-1014 (visited on 29/01/2020) (cit. on pp. 51, 52, 56, 60, 61, 65).

Nicolas, Pascale, Sabine Letellier-Zarshenas, Igor Schadle, Jean-Yves Antoine and Jean Caelen (2002). 'Towards a large corpus of spoken dialogue in French that will be freely available: the "Parole Publique" project and its first realisations'. In: *Proceedings of the Third International Conference on Language Resources and Evaluation*. LREC 2002 (Las Palmas de Gran Canaria, Canarias, España). European Language Resources Association, May 2002. URL: http://www.lrec-conf.org/proceedings/lrec2002/pdf/111.pdf (visited on 10/01/2020) (cit. on p. 36).

Nitoń, Bartłomiej, Paweł Morawiecki and Maciej Ogrodniczuk (2018). 'Deep Neural Networks for Coreference Resolution for Polish'. In: *Proceedings of the Eleventh International Conference on Language Resources and Evaluation*. LREC 2018. Miyazaki, Japan: European Languages Resources Association, May 2018. URL: https://www.aclweb.org/anthology/L18-1060 (visited on 22/09/2019) (cit. on pp. 54, 72).

Niven, Timothy and Hung-Yu Kao (2019). 'Probing Neural Network Comprehension of Natural Language Arguments'. In: *Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics*. ACL 2019. Firenze, Italia: Association for Computational Linguistics, pp. 4658–4664. DOI: 10.18653/v1/P19-1459. URL: https://www.aclweb.org/anthology/P19-1459 (visited on 22/09/2019) (cit. on p. 72).

Nivre, Joakim et al. (2016). 'Universal Dependencies v1: A Multilingual Treebank Collection'. In: *Proceedings of the Tenth International Conference on Language Resources and Evaluation*. LREC 2016 (23rd–28th May 2016). Ed. by Nicoletta Calzolari et al. Portorož, Slovenia: European Language Resources Association, May 2016 (cit. on pp. 45, 103).

Nothman, Joel, Nicky Ringland, Will Radford, Tara Murphy and James R. Curran (2013). 'Learning multilingual named entity recognition from Wikipedia'. In: *Artificial Intelligence*. Artificial Intelligence, Wikipedia and Semi-Structured Resources 194 (1st Jan. 2013), pp. 151–175. DOI: 10.1016/j.artint.2012.03.006. URL: http://www.sciencedirect.com/science/article/pii/S0004370212000276 (visited on 17/02/2020) (cit. on p. 103).

Ogrodniczuk, Maciej, Katarzyna Głowińska, Mateusz Kopeć, Agata Savary and Magdalena Zawisławska (2016). 'Polish Coreference Corpus'. In: *Human Language Technology. Challenges for Computer Science and Linguistics*. Ed. by Zygmunt Vetulani, Hans Uszkoreit and Marek Kubis. Lecture Notes in Computer Science. Springer International Publishing, pp. 215–226 (cit. on pp. 33, 39, 41, 43).

Ogrodniczuk, Maciej and Vincent Ng, eds. (2016). *Proceedings of the Workshop on Coreference Resolution Beyond OntoNotes (CORBON 2016)*. San Diego, California: Association for Computational Linguistics, June 2016. DOI: 10.18653/v1/W16-07. URL: https://www.aclweb.org/anthology/W16-0700 (visited on 20/01/2020) (cit. on p. 34).
Ogrodniczuk, Maciej and Vincent Ng, eds. (2017). *Proceedings of the 2nd Workshop on Coreference Resolution Beyond OntoNotes (CORBON 2017)*. Valencia, Spain: Association for Computational Linguistics, Apr. 2017. DOI: 10.18653/v1/W17-15. URL: https://www.aclweb.org/anthology/W17-1500 (visited on 20/01/2020) (cit. on p. 34).

Ortiz Suárez, Pedro Javier, Yoann Dupont, Benjamin Muller, Laurent Romary and Benoît Sagot (2020). 'Establishing a New State-of-the-Art for Named Entity Recognition'. In: *Proceedings of the 11th International Conference on Language Resources and Evaluation*. LREC 2020 (Marseilles, France). European Language Resource Association (cit. on p. 101).

Ortiz Suárez, Pedro Javier, Benoît Sagot and Laurent Romary (2019). 'Asynchronous Pipeline for Processing Huge Corpora on Medium to Low Resource Infrastructures'. In: *7th Workshop on the Challenges in the Management of Large Corpora*. CMLC'7 (Cardiff, United Kingdom). Ed. by Piotr Bański, Adrien Barbaresi, Hanno Biber, Evelyn Breiteneder, Simon Clematide, Marc Kupietz, Harald Lüngen and Caroline Iliadi. Leibniz-Institut für Deutsche Sprache, July 2019. URL: https://hal.inria.fr/hal-02148693 (visited on 31/01/2020) (cit. on pp. 54, 101).

Pāṇini (–0349). *Aṣṭādhyāyī* (cit. on p. 106).

Paszke, Adam et al. (2017). 'Automatic differentiation in PyTorch'. In: NeurIPS 2017 Autodiff Workshop: The Future of Gradient-based Machine Learning Software and Techniques. Long Beach, CA, 9th Dec. 2017. URL: https://openreview.net/forum?id=BJJsrmfCZ (visited on 19/08/2019) (cit. on p. 80).

Pennington, Jeffrey, Richard Socher and Christopher Manning (2014). 'Glove: Global Vectors for Word Representation'. In: *Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing*. EMNLP 2014 (Doha, Qatar). Association for Computational Linguistics, Oct. 2014, pp. 1532–1543. DOI: 10.3115/v1/D14-1162. URL: https://www.aclweb.org/anthology/D14-1162 (visited on 16/02/2020) (cit. on p. 100).

Peters, Matthew, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee and Luke Zettlemoyer (2018). 'Deep Contextualized Word Representations'. In: *Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies*. NAACL: HLT 2018 (New Orleans, Louisiana). Vol. 1. New Orleans, Louisiana, USA: Association for Computational Linguistics, June 2018, pp. 2227–2237. DOI: 10.18653/v1/N18-1202. URL: http://aclweb.org/anthology/N18-1202 (visited on 16/02/2019) (cit. on pp. 72, 85, 101).

Plank, Barbara, Anders Søgaard and Yoav Goldberg (2016). 'Multilingual Part-of-Speech Tagging with Bidirectional Long Short-Term Memory Models and Auxiliary Loss'. In: *Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics*. ACL 2016. Vol. 2. Berlin, Germany: Association for Computational Linguistics, pp. 412–418. DOI: 10.18653/v1/P16-2067. URL: http://aclweb.org/anthology/P16-2067 (visited on 03/09/2019) (cit. on p. 72).

Poesio, Massimo (2004). 'The MATE/GNOME Proposals for Anaphoric Annotation, Revisited'. In: *Proceedings of the 5th SIGDIAL Workshop*. Boston, Massachusetts, USA, pp. 154–162. URL: http://cswww.essex.ac.uk/staff/poesio/publications/SIGDIAL04.pdf (visited on 06/07/2017) (cit. on p. 40).

Poesio, Massimo (2016). 'Linguistic and Cognitive Evidence About Anaphora'. In: *Anaphora Resolution: Algorithms, Resources, and Applications*. Ed. by Massimo Poesio, Roland Stuck-
ardt and Yannick Versley. Theory and Applications of Natural Language Processing. Berlin, Heidelberg: Springer, pp. 23–54. DOI: 10.1007/978-3-662-47909-4_2. URL: https://doi.org/10.1007/978-3-662-47909-4_2 (visited on 24/11/2019) (cit. on p. 19).

Poesio, Massimo, Mijail Alexandrov-Kabadjov, Renata Vieira, Rodrigo Goulart and Olga Uryupina (2005). ‘Does discourse-new detection help definite description resolution’. In: *Proceedings of the 6th International Workshop on Computational Semantics*. IWCS 2005 (Tilburg, Nederland), pp. 236–246 (cit. on pp. 52, 78).

Poesio, Massimo and Ron Artstein (2008). ‘Anaphoric Annotation in the ARRAU Corpus’. In: *Proceedings of the 10th International Conference on Language Resources and Evaluation*. LREC 2008. Marrakech, Morocco: European Language Resources Association. URL: http://ict.usc.edu/pubs/Anaphoric%20Annotation%20in%20the%20ARRAU%20Corpus.pdf (cit. on pp. 31, 40, 64).

Poesio, Massimo, Florence Bruneseaux and Laurent Romary (1999). ‘The MATE meta-scheme for coreference in dialogues in multiple languages’. In: *ACL’99 Workshop Towards Standards and Tools for Discourse Tagging*. College Parc, United States, June 1999, pp. 65–74. URL: https://hal.inria.fr/inria-00525171 (visited on 06/07/2017) (cit. on p. 40).

Poesio, Massimo, Sameer Pradhan, Marta Recasens, Kepa Rodriguez and Yannick Versley (2016a). ‘Annotated Corpora and Annotation Tools’. In: *Anaphora Resolution: Algorithms, Resources, and Applications*. Ed. by Massimo Poesio, Roland Stuckardt and Yannick Versley. Theory and Applications of Natural Language Processing. Berlin, Heidelberg: Springer, pp. 97–163. DOI: 10.1007/978-3-662-47909-4_2. URL: https://doi.org/10.1007/978-3-662-47909-4_2 (visited on 24/11/2019) (cit. on pp. 34, 35).

Poesio, Massimo, Ron Stuckardt and Yannick Versley, eds. (2016b). *Anaphora Resolution: Algorithms, Resources, and Applications*. Theory and Applications of Natural Language Processing. Springer-Verlag Berlin Heidelberg. URL: http://www.springer.com/fr/book/9783662479087 (visited on 06/12/2016) (cit. on p. 22).

Poesio, Massimo, Ron Stuckardt, Yannick Versley and Renata Vieira (2016c). ‘Early Approaches to Anaphora Resolution: Theoretically Inspired and Heuristic-Based’. In: *Anaphora Resolution: Algorithms, Resources, and Applications*. Ed. by Massimo Poesio, Roland Stuckardt and Yannick Versley. Theory and Applications of Natural Language Processing. Berlin, Heidelberg: Springer, pp. 55–94. DOI: 10.1007/978-3-662-47909-4_2. URL: https://doi.org/10.1007/978-3-662-47909-4_2 (visited on 24/11/2019) (cit. on p. 17).

Poesio, Massimo et al. (2018). ‘Anaphora Resolution with the ARRAU Corpus’. In: *Proceedings of the First Workshop on Computational Models of Reference, Anaphora and Coreference*. CRAC 2018 (New Orleans, Louisiana). New Orleans, Louisiana, USA: Association for Computational Linguistics, 6th June 2018, pp. 11–22. DOI: 10.18653/v1/W18-0702. URL: http://aclweb.org/anthology/W18-0702 (visited on 01/03/2019) (cit. on pp. 64, 89).

Popescu-Belis, Andrei (1999). ‘Modélisation multi-agents des échanges langagiers : application au problème de la référence et à son évaluation’. thesis. Paris 11, 1st Jan. 1999. URL: http://www.theses.fr/1999PA112200 (visited on 21/01/2020) (cit. on pp. 35, 36).

Popescu-Belis, Andrei, Loïs Rigouste, Susanne Salmon-Alt and Laurent Romary (2004). ‘Online Evaluation of Coreference Resolution.’ In: *4th International Conference on Language Resources and Evaluation*. LREC 2004. Lisboa, Portugal: European Language Resources Association.
URL: https://halshs.archives-ouvertes.fr/halshs-00005023/document (visited on
01/03/2019) (cit. on p. 20).

Pradhan, Sameer, Eduard Hovy, Mitch Marcus, Martha Palmer, Lance Ramshaw and Ralph Weischedel (2007a). ‘OntoNotes: A Unified Relational Semantic Representation’. In: *Proceedings of the First IEEE International Conference on Semantic Computing*. ICSC 2007 (Irvine, California, USA). IEEE Computer Society, pp. 517–526. DOI: 10.1109/ICSC.2007.67. URL: http://dx.doi.org/10.1109/ICSC.2007.67 (visited on 06/07/2017) (cit. on pp. 5, 64).

Pradhan, Sameer, Xiaoqiang Luo, Marta Recasens, Eduard Hovy, Vincent Ng and Michael Strube (2014). ‘Scoring Coreference Partitions of Predicted Mentions: A Reference Implementation’. In: *Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics*. ACL 2014. Vol. 2. Baltimore, Maryland, USA: Association for Computational Linguistics, June 2014, pp. 30–35. URL: http://www.aclweb.org/anthology/P14-2006 (cit. on pp. 24, 26).

Pradhan, Sameer, Alessandro Moschitti, Nianwen Xue, Olga Uryupina and Yuchen Zhang (2012). ‘CoNLL-2012 Shared Task: Modeling Multilingual Unrestricted Coreference in OntoNotes’. In: *Proceedings of the Joint EMNLP-CoNLL conference*. EMNLP-CoNLL 2012 (××××, ××××× (Jeju Island, Republic of Korea)). Stroudsburg, Pennsylvania, USA: Association for Computational Linguistics, pp. 1–40. URL: http://aclweb.org/anthology/W12-4501 (visited on 28/02/2019) (cit. on pp. 30, 33, 64).

Pradhan, Sameer, Lance Ramshaw, Mitchell Marcus, Martha Palmer, Ralph Weischedel and Nianwen Xue (2011). ‘CoNLL-2011 Shared Task: Modeling Unrestricted Coreference in OntoNotes’. In: *Proceedings of the Fifteenth Conference on Computational Natural Language Learning*. CoNLL 2011 (Portland, Oregon, USA). CONLL Shared Task ’11. Association for Computational Linguistics, pp. 1–27. URL: http://dl.acm.org/citation.cfm?id=2132936.2132937 (visited on 01/10/2017) (cit. on pp. 30, 33, 64).

Pradhan, Sameer, Lance Ramshaw, Ralph Weischedel, Jessica MacBride and Linnea Micciulla (2007b). ‘Unrestricted Coreference: Identifying Entities and Events in OntoNotes’. In: *Proceedings of the First IEEE International Conference on Semantic Computing*. ICSC 2007 (Irvine, California, USA). Minneapolis, Minnesota, USA, Sept. 2007, pp. 446–453. DOI: 10.1109/ICSC.2007.93 (cit. on pp. 19, 34, 39).

Prince, Ellen Friedman (1981). ‘Toward a taxonomy of given - new information’. In: *Radical pragmatics*. Ed. by Peter Cole. New York: Academic Press, pp. 223–255 (cit. on pp. 3, 8, 9, 12, 40).

Quignard, Matthieu, Serge Heiden, Frédéric Landragin and Matthieu Decorde (2018). ‘Textometric Exploitation of Coreference-annotated Corpora with TXM: Methodological Choices and First Outcomes’. In: *Proceedings of the Fourteenth International Conference on the Statistical Analysis of Textual Data*. JADT 2018. Univers'Italia, 11th June 2018, pp. 610–615. URL: https://hal.archives-ouvertes.fr/hal-01814858 (visited on 04/02/2020) (cit. on p. 47).

Radford, Alec, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei and Ilya Sutskever (2019). ‘Language models are unsupervised multitask learners’ (cit. on p. 81).

Raghunathan, Karthik, Heeyoung Lee, Sudarshan Rangarajan, Nathanael Chambers, Mihai Surdeanu, Dan Jurafsky and Christopher D. Manning (2010). ‘A Multi-pass Sieve for Coreference Resolution’. In: *Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing*. EMNLP 2010 (Cambridge, Massachusetts, USA). Association for Com-
putational Linguistics, pp. 492–501. URL: http://dl.acm.org/citation.cfm?id=1870658. 1870706 (visited on 31/01/2017) (cit. on pp. 63, 96, 97).

Rahman, Altaf and Vincent Ng (2009). ‘Supervised models for coreference resolution’. In: *Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing*. EMNLP 2009 (Singapore). Vol. 2. Association for Computational Linguistics, p. 968. DOI: 10.3115/1699571.1699639. URL: http://portal.acm.org/citation.cfm?doid=1699571.1699639 (visited on 29/09/2019) (cit. on p. 85).

Rahman, Altaf and Vincent Ng (2011). ‘Narrowing the Modeling Gap: A Cluster-Ranking Approach to Coreference Resolution’. In: *Journal of Artificial Intelligence Research* 40 (25th Feb. 2011), pp. 469–521. DOI: 10.1613/jair.3120. URL: https://www.jair.org/index.php/jair/article/view/10694 (visited on 30/01/2020) (cit. on p. 63).

Rand, William M. (1971). 'Objective Criteria for the Evaluation of Clustering Methods'. In: *Journal of the American Statistical Association* 66.336, pp. 846–850. DOI: 10.2307/2284239.
JSTOR: 2284239 (cit. on p. 25).

Rastier, François (2002). ‘Enjeux épistémologiques de la linguistique de corpus’. In: *Deuxièmes journées de la linguistique de corpus*. Ed. by Williams G. Lorient, France: Presses Universitaires de Rennes, Sept. 2002, pp. 31–46. URL: https://hal.archives-ouvertes.fr/hal-00171532 (visited on 19/12/2019) (cit. on p. 30).

Recasens, Marta (2010). ‘Coreference: Theory, Annotation, Resolution and Evaluation.’ Universitat de Barcelona. URL: http://stel.ub.edu/cba2010/phd/phd.pdf (visited on 18/10/2016) (cit. on pp. 14, 20, 21, 78).

Recasens, Marta, Marie-Catherine de Marneffe and Christopher Potts (2013). ‘The Life and Death of Discourse Entities: Identifying Singleton Mentions’. In: *Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies*. NAACL: HLT 2013 (Atlanta, Georgia, USA). Association for Computational Linguistics, June 2013, pp. 627–633. URL: https://www.aclweb.org/anthology/N13-1071 (visited on 29/01/2020) (cit. on p. 53).

Recasens, Marta and Eduard Hovy (2009). ‘A Deeper Look into Features for Coreference Resolution’. In: *Anaphora Processing and Applications*. Ed. by Sobha Lalitha Devi, António Branco and Ruslan Mitkov. Lecture Notes in Computer Science. Berlin, Heidelberg: Springer, pp. 29–42. DOI: 10.1007/978-3-642-04975-0_3 (cit. on p. 52).

Recasens, Marta and Eduard Hovy (2010). ‘Coreference Resolution across Corpora: Languages, Coding Schemes, and Preprocessing Information’. In: *Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics*. ACL 2010 (Uppsala, Sverige, 11th–16th July 2010). Uppsala, Sverige: Association for Computational Linguistics, pp. 1423–1432. URL: http://www.aclweb.org/anthology/P10-1144 (visited on 31/01/2017) (cit. on pp. 17, 63).

Recasens, Marta and Eduard Hovy (2011). ‘BLANC: Implementing the Rand Index for Coreference Evaluation’. In: *Natural Language Engineering* 17.4 (Oct. 2011), pp. 485–510. DOI: 10.1017/S135132491000029X. URL: http://dx.doi.org/10.1017/S135132491000029X (cit. on pp. 20, 23–25).

Recasens, Marta, Eduard Hovy and M. Antònia Martí (2011a). ‘Identity, non-identity, and near-identity: Addressing the complexity of coreference’. In: *Lingua* 121.6 (1st May 2011), pp. 1138–
1152. DOI: 10.1016/j.lingua.2011.02.004. URL: http://www.sciencedirect.com/science/article/pii/S0024384111000325 (visited on 05/08/2019) (cit. on pp. 10, 19, 42).

Recasens, Marta, Lluís Màrquez, Emili Sapena, M. Antònia Martí, Mariona Taulé, Véronique Hoste, Massimo Poesio and Yannick Versley (2010). ‘SemEval-2010 task 1: Coreference resolution in multiple languages’. In: *Proceedings of the 5th International Workshop on Semantic Evaluation*. SemEval 2010 (Uppsala, Sverige). Association for Computational Linguistics, pp. 1–8 (cit. on pp. 26, 33, 64, 112).

Recasens, Marta, Lluís Màrquez, Emili Sapena, M. Antònia Martí, Mariona Taulé, Véronique Hoste, Massimo Poesio and Yannick Versley (2011b). *SemEval-2010 task 1: Coreference resolution in multiple languages*. Dataset release LDC2011T01. Philadelphia, Pennsylvania, USA: Linguistic Data Consortium. URL: https://catalog.ldc.upenn.edu/LDC2011T01 (visited on 20/01/2020) (cit. on p. 35).

Reddi, Sashank J., Satyen Kale and Sanjiv Kumar (2018). ‘On the Convergence of Adam and Beyond’. In: Sixth International Conference on Learning Representations. Vancouver, Canada, 30th Apr. 2018. URL: https://openreview.net/forum?id=ryQu7f-RZ (visited on 19/08/2019) (cit. on p. 80).

Rodríguez, Kepa Joseba, Francesca Delogu, Yannick Versley, Egon W. Stemle and Massimo Poesio (2010–0021). ‘Anaphoric Annotation of Wikipedia and Blogs in the Live Memories Corpus’. In: *Proceedings of the Seventh International Conference on Language Resources and Evaluation*. LREC 2010. Ed. by Khalid Choukri, Joseph Mariani, Jan Odijk, Stelios Piperidis, Mike Rosner, Daniel Tapias and Nicoletta Calzolari. Valletta, Malta: European Language Resources Association, 19th May 2010–21 (cit. on p. 40).

Roesiger, Ina, Maximilian Köper, Kim Anh Nguyen and Sabine Schulte im Walde (2018). ‘Integrating Predictions from Neural-Network Relation Classifiers into Coreference and Bridging Resolution’. In: *Proceedings of the First Workshop on Computational Models of Reference, Anaphora and Coreference*. New Orleans, Louisiana: Association for Computational Linguistics, June 2018, pp. 44–49. DOI: 10.18653/v1/W18-0705. URL: https://www.aclweb.org/anthology/W18-0705 (visited on 18/01/2020) (cit. on p. 77).

Rogers, Anna (2019). *How the Transformers broke NLP leaderboards*. 30th June 2019. URL: https://hackingsemantics.xyz/2019/leaderboards/ (visited on 22/09/2019) (cit. on p. 73).

Romary, Laurent (2017). *stdfSpec: A proposal for a stand-off element for the TEI Guidelines*. 7th July 2017. URL: https://github.com/laurentromary/stdfSpec (cit. on p. 44).

Rosset, Sophie, Cyril Grouin and Pierre Zweigenbaum (2011). *Entités nommées structurées : guide d'annotation Quaero*. Notes LIMSI 2011-04. Orsay, France: Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur, 8th Sept. 2011, p. 86. URL: http://www.quaero.org/media/files/bibliographie/quaero-guide-annotation-2011.pdf (visited on 21/11/2019) (cit. on p. 16).

Roth, Dan and Wen-tau Yih (2007). ‘Global Inference for Entity and Relation Identification via a Linear Programming Formulation’. In: *Introduction to Statistical Relational Learning*. Ed. by Lise Getoor and Ben Taskar. The MIT Press. DOI: 10.7551/mitpress/7432.003.0022. URL: https://direct.mit.edu/books/book/3811/chapter/125093/global-inference-for-entity-and-relation (visited on 09/02/2020) (cit. on p. 61).
Rubenstein, Herbert and John B. Goodenough (1965). 'Contextual correlates of synonymy'. In: *Communications of the ACM* 8.10 (1st Oct. 1965), pp. 627–633. DOI: 10.1145/365628.365657. URL: https://doi.org/10.1145/365628.365657 (visited on 16/02/2020) (cit. on p. 99).

Ruder, Sebastian (2017). *An Overview of Multi-Task Learning in Deep Neural Networks*. 15th June 2017. arXiv: 1706.05098 [cs, stat]. URL: http://arxiv.org/abs/1706.05098 (visited on 26/03/2019) (cit. on p. 86).

Ruder, Sebastian (2019). 'Neural Transfer Learning for Natural Language Processing'. PhD Thesis. Galway, Éire: National University of Ireland. URL: http://ruder.io/thesis/ (cit. on p. 85).

Rumelhart, David E., Geoffrey E. Hinton and Ronald J. Williams (1986). 'Learning representations by back-propagating errors'. In: *Nature* 323.6088 (Oct. 1986), pp. 533–536. DOI: 10.1038/323533a0. URL: https://www.nature.com/articles/323533a0 (visited on 17/09/2019) (cit. on p. 80).

Russell, Bertrand (1919). 'The philosophy of logical atomism'. In: *The Monist* 29.1, pp. 32–63. JSTOR: 27900724 (cit. on p. 9).

Sakaguchi, Keisuke, Ronan Le Bras, Chandra Bhagavatula and Yejin Choi (2019). *WINOGRANDE: An Adversarial Winograd Schema Challenge at Scale*. 24th July 2019. arXiv: 1907.10641 [cs]. URL: http://arxiv.org/abs/1907.10641 (visited on 30/07/2019) (cit. on p. 18).

Salimans, Tim and Diederik P. Kingma (2016). *Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks*. 25th Feb. 2016. arXiv: 1602.07868 [cs]. URL: http://arxiv.org/abs/1602.07868 (visited on 10/09/2019) (cit. on p. 82).

Salmon-Alt, Susanne (2002). 'Le projet ANANAS : Annotation anaphorique pour l'analyse sémantique de corpus'. In: *Actes de la 9ème conférence annuelle sur le Traitement Automatique des Langues Naturelles*. TALN 2002 (24th-27th June 2002). Nancy, France. URL: http://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=14215371 (visited on 21/01/2020) (cit. on pp. 35, 36).

Salmon-Alt, Susanne, Eckhard Bick, Laurent Romary and Jean-Marie Pierrel (2004). 'La FReeBank : vers une base libre de corpus annotés'. In: *Traitement Automatique des Langues Naturelles - TALN'04*. Apr. 2004, 10 p. URL: https://hal.inria.fr/inria-00100194 (visited on 21/01/2020) (cit. on pp. 35, 36).

Sanh, Victor, Thomas Wolf and Sebastian Ruder (2018). *A Hierarchical Multi-task Approach for Learning Embeddings from Semantic Tasks*. 14th Nov. 2018. arXiv: 1811.06031 [cs]. URL: http://arxiv.org/abs/1811.06031 (visited on 28/02/2019) (cit. on pp. 86, 112).

Santurkar, Shibani, Dimitris Tsipras, Andrew Ilyas and Aleksander Madry (2018). *How Does Batch Normalization Help Optimization?*. 29th May 2018. arXiv: 1805.11604 [cs, stat]. URL: http://arxiv.org/abs/1805.11604 (visited on 10/09/2019) (cit. on p. 83).

Schmid, Hellmut (1994). 'Probabilistic Part-of-Speech Tagging Using Decision Trees'. In: *Proceedings of the International Conference on New Methods in Language Processing*. International Conference on New Methods in Language Processing. Manchester, UK. URL: https://cis.uni-muenchen.de/~schmid/tools/TreeTagger/data/tree-tagger1.pdf (cit. on p. 40).

Schuster, Mike and Kuldip K. Paliwal (1997). 'Bidirectional recurrent neural networks'. In: *IEEE Transactions on Signal Processing* 45.11 (Nov. 1997), pp. 2673–2681. DOI: 10.1109/78.650093 (cit. on pp. 6, 73).
Sekine, Satoshi and Chikashi Nobata (2004). 'Definition, Dictionaries and Tagger for Extended Named Entity Hierarchy'. In: *Proceedings of the Fourth International Conference on Language Resources and Evaluation*. LREC 2004 (Lisbon, Portugal). European Language Resources Association, May 2004. URL: http://www.lrec-conf.org/proceedings/lrec2004/pdf/65.pdf (visited on 24/02/2020) (cit. on p. 16).

Sennrich, Rico, Barry Haddow and Alexandra Birch (2016). 'Neural Machine Translation of Rare Words with Subword Units'. In: *Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics*. ACL 2016 (Berlin, Deutschland). Association for Computational Linguistics, Aug. 2016, pp. 1715-1725. DOI: 10.18653/v1/P16-1162. URL: https://www.aclweb.org/anthology/P16-1162 (visited on 16/02/2020) (cit. on p. 102).

Sha, Fei and Fernando Pereira (2003). 'Shallow Parsing with Conditional Random Fields'. In: *Proceedings of the 2003 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics*. HLT-NAACL 2003 (Edmonton, Canada), pp. 213-220. URL: https://www.aclweb.org/anthology/N03-1028 (visited on 17/02/2020) (cit. on p. 105).

Shen, Dinghan et al. (2018). ‘Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanisms’. In: *Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics*. ACL 2018. Vol. 1. Melbourne, Australia: Association for Computational Linguistics, pp. 440–450. DOI: 10.18653/v1/P18-1041. URL: http://aclweb.org/anthology/P18-1041 (visited on 22/09/2019) (cit. on p. 72).

Shimodaira, Hidetoshi (2000). 'Improving predictive inference under covariate shift by weighting the log-likelihood function'. In: *Journal of Statistical Planning and Inference* 90.2 (1st Oct. 2000), pp. 227–244. DOI: 10.1016/S0378-3758(00)00115-4. URL: http://www.sciencedirect.com/science/article/pii/S0378375800001154 (visited on 10/09/2019) (cit. on p. 83).

Shoeybi, Mohammad, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper and Bryan Catanzaro (2019). *Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism*. 17th Sept. 2019. arXiv: 1909.08053 [cs]. URL: http://arxiv.org/abs/1909.08053 (visited on 27/09/2019) (cit. on p. 81).

Simpson, George Gaylord (1947). 'Holarctic Mammalian Faunas and Continental Relationships during the Cenozoic'. In: *Geological Society of America Bulletin* 58, p. 613. DOI: 10.1130/0016-7606(1947)58[613:HMFACR]2.0.CO;2. URL: http://adsabs.harvard.edu/abs/1947GSAB.0016-7606(1947)58[613:HMFACR]2.0.CO;2 (visited on 16/02/2020) (cit. on p. 98).

Smith, Aaron, Bernd Bohnet, Miryam de Lhoneux, Joakim Nivre, Yan Shao and Sara Stymne (2018). '82 Treebanks, 34 Models: Universal Dependency Parsing with Multi-Treebank Models'. In: *Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies*. CoNLL 2018 (Bruxelles, Belgique). Association for Computational Linguistics, Oct. 2018, pp. 113–123. DOI: 10.18653/v1/K18-2011. URL: https://www.aclweb.org/anthology/K18-2011 (visited on 07/02/2020) (cit. on p. 112).

Smyth, Ron (1994). 'Grammatical determinants of ambiguous pronoun resolution'. In: *Journal of Psycholinguistic Research* 23.3 (1st Sept. 1994), pp. 197-229. DOI: 10.1007/BF02139085. URL: https://doi.org/10.1007/BF02139085 (visited on 05/02/2020) (cit. on p. 56).

Søgaard, Anders and Yoav Goldberg (2016). 'Deep multi-task learning with low level tasks supervised at lower layers'. In: 54th Annual Meeting of the Association for Computational
Linguistics. ACL 2016. Vol. 2. Berlin, Deutschland: Association for Computational Linguistics, Aug. 2016, pp. 231–235. DOI: 10.18653/v1/P16-2038. URL: http://www.aclweb.org/anthology/P16-2038 (visited on 26/03/2019) (cit. on p. 86).

Song, Zhiyi et al. (2015). ‘From Light to Rich ERE: Annotation of Entities, Relations, and Events’. In: 3rd Workshop on EVENTS: Definition, Detection, Coreference, and Representation. Denver, Colorado: Association for Computational Linguistics, pp. 89–98. DOI: 10.3115/v1/W15-0812. URL: http://aclweb.org/anthology/W15-0812 (visited on 24/11/2019) (cit. on p. 18).

Soon, Wee Meng, Hwee Tou Ng and Chung Yong Lim (2001). ‘A Machine Learning Approach to Coreference Resolution of Noun Phrases’. In: *Computational Linguistics* 27.4, pp. 521–544. DOI: 10.1162/089120101753342653. URL: https://www.aclweb.org/anthology/J01-4004/ (visited on 14/08/2019) (cit. on pp. 51–53, 56, 59, 60, 65, 98).

Soraluze, Ander, Olatz Arregi, Xabier Arregi, Klara Ceberio and Arantza Díaz de Ilarraza (2012). ‘Mention detection: First steps in the development of a Basque coreference resolution system’. In: *Proceedings of KONVENS 2012*. Ed. by Jeremy Jancsary. ÖGAI, Sept. 2012, pp. 128–136. URL: http://www.oegai.at/konvens2012/proceedings/18_soraluze120/ (visited on 30/11/2016) (cit. on pp. 33, 40, 65, 76, 105).

Soraluze, Ander, Olatz Arregi, Xabier Arregi and Arantza Díaz de Ilarraza (2019). ‘EUSKOR: End-to-end coreference resolution system for Basque’. In: *PLOS ONE* 14.9 (12th Sept. 2019), e0221801. DOI: 10.1371/journal.pone.0221801. URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0221801 (visited on 17/09/2019) (cit. on p. 53).

Soraluze, Ander, Olatz Arregi, Xabier Arregi and Arantza Díaz de Ilarraza (2017). ‘Improving mention detection for Basque based on a deep error analysis’. In: *Natural Language Engineering* 23.3 (May 2017), pp. 351–384. DOI: 10.1017/S1351324916000206. URL: https://www.cambridge.org/core/journals/natural-language-engineering/article/improving-mention-detection-for-basque-based-on-a-deep-error-analysis/89C8669493FC0942CC32013BE57D8C0C (visited on 17/09/2019) (cit. on pp. 65, 76, 89).

Sørensen, Thorvald Julius (1948). *A method of establishing groups of equal amplitude in plant sociology based on similarity of species content and its application to analyses of the vegetation on Danish commons*. København: E. Munksgaard (cit. on p. 24).

Srivastava, Nitish, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever and Ruslan Salakhutdinov (2014). ‘Dropout: A Simple Way to Prevent Neural Networks from Overfitting’. In: *Journal of Machine Learning Research* 15, pp. 1929–1958. URL: http://jmlr.org/papers/v15/srivastava14a.html (visited on 06/09/2019) (cit. on pp. 81, 82).

Stern, Mitchell, Jacob Andreas and Dan Klein (2017). ‘A Minimal Span-Based Neural Constituency Parser’. In: 55th Annual Meeting of the Association for Computational Linguistics. Vol. 1. Vancouver, Canada: Association for Computational Linguistics, pp. 818–827. DOI: 10.18653/v1/P17-1076. URL: http://aclweb.org/anthology/P17-1076 (visited on 28/02/2019) (cit. on p. 74).

Stevenson, Rosemary J., Alexander W. R. Nelson and Keith Stenning (1995). ‘The Role of Parallelism in Strategies of Pronoun Comprehension’. In: *Language and Speech* 38.4 (1st Oct. 1995), pp. 393–418. DOI: 10.1177/002383099503800404. URL: https://doi.org/10.1177/002383099503800404 (visited on 05/02/2020) (cit. on p. 56).
Stoyanov, Veselin, Claire Cardie, Nathan Gilbert, Ellen Riloff, David Buttler and David Hysom (2010). ‘Coreference Resolution with Reconcile’. In: *Proceedings of the ACL 2010 Conference*. ACL 2010 (Uppsala, Sverige). Vol. Short papers. Association for Computational Linguistics, July 2010, pp. 156–161. URL: https://www.aclweb.org/anthology/P10-2029 (visited on 30/01/2020) (cit. on p. 65).

Stoyanov, Veselin and Jason Eisner (2012). ‘Easy-first Coreference Resolution’. In: URL: https://core.ac.uk/display/22102734 (visited on 10/02/2020) (cit. on p. 64).

Stoyanov, Veselin, Nathan Gilbert, Claire Cardie and Ellen Riloff (2009). ‘Conundrums in Noun Phrase Coreference Resolution: Making Sense of the State-of-the-Art’. In: *Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP*. ACL-AFNLP 2009 (Suntec, Singapore). Association for Computational Linguistics, Aug. 2009, pp. 656–664. URL: https://www.aclweb.org/anthology/P09-1074 (visited on 30/11/2019) (cit. on p. 64).

Straka, Milan and Jana Straková (2017). ‘Tokenizing, POS Tagging, Lemmatizing and Parsing UD 2.0 with UDPipe’. In: *Proceedings of the CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies*. CoNLL 2017. Vancouver, Canada: Association for Computational Linguistics, Aug. 2017, pp. 88–99. DOI: 10.18653/v1/K17-3009. URL: https://www.aclweb.org/anthology/K17-3009 (visited on 23/01/2020) (cit. on p. 45).

Straka, Milan and Jana Straková (2019). ‘ÚFAL MRPipe at MRP 2019: UDPipe Goes Semantic in the Meaning Representation Parsing Shared Task’. In: *Proceedings of the Shared Task on Cross-Framework Meaning Representation Parsing at the 2019 Conference on Natural Language Learning*. CoNLL 2019 (Hong Kong). Association for Computational Linguistics, Nov. 2019, pp. 127–137. DOI: 10.18653/v1/K19-2012. URL: https://www.aclweb.org/anthology/K19-2012 (visited on 17/02/2020) (cit. on p. 103).

Straková, Jana, Milan Straka and Jan Hajic (2019). ‘Neural Architectures for Nested NER through Linearization’. In: *Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics*. ACL 2019. Firenze, Italia: Association for Computational Linguistics, July 2019, pp. 5326–5331. URL: https://www.aclweb.org/anthology/P19-1527 (visited on 06/08/2019) (cit. on p. 16).

Sturt, Patrick and Vincenzo Lombardo (2005). ‘Processing Coordinated Structures: Incrementality and Connectedness’. In: *Cognitive Science* 29.2, pp. 291–305. DOI: 10.1207/s15516709cog0000_8. URL: https://onlinelibrary.wiley.com/doi/abs/10.1207/s15516709cog0000_8 (visited on 08/02/2020) (cit. on p. 58).

Sukhbaatar, Sainbayar, Arthur Szlam, Jason Weston and Rob Fergus (2015). ‘End-To-End Memory Networks’. In: *Advances in Neural Information Processing Systems*. NeurIPS 2015 (Montréal, Canada). Ed. by C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama and R. Garnett. Vol. 28. Curran Associates, Inc., pp. 2440–2448. URL: http://papers.nips.cc/paper/5846-end-to-end-memory-networks.pdf (visited on 06/02/2020) (cit. on p. 57).

Sutskever, Ilya, Oriol Vinyals and Quoc V Le (2014). ‘Sequence to Sequence Learning with Neural Networks’. In: *Advances in Neural Information Processing Systems*. 28th conference on Neural Information Processing. Ed. by Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence and K. Q. Weinberger. Vol. 27. Montréal, Canada: Curran Associates, Inc., pp. 3104–3112. URL:
http://papers.nips.cc/paper/5346-sequence-to-sequence-learning-with-neural-networks.pdf (visited on 21/09/2019) (cit. on p. 74).

Swayamdipta, Swabha, Sam Thomson, Kenton Lee, Luke Zettlemoyer, Chris Dyer and Noah A. Smith (2018). ‘Syntactic Scaffolds for Semantic Structures’. In: *Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing*. EMNLP 2018. Association for Computational Linguistics, Oct. 2018, pp. 3772–3782. DOI: 10.18653/v1/D18-1412. URL: https://www.aclweb.org/anthology/D18-1412 (visited on 19/02/2020) (cit. on p. 112).

Szymkiewicz, Dezydery (1934). *Une Contribution statistique à la géographie floristique*. Polskie Towarzystwo Botaniczne. 17 pp. Google Books: AK13oAEACAAJ (cit. on p. 98).

Taulé, Mariona, M. Antònia Martí and Marta Recasens (2008). ‘AnCora: Multilevel Annotated Corpora for Catalan and Spanish’. In: *Proceedings of the 6th International Conference on Language Resources and Evaluation*. Marrakech, Morroco: European Language Resources Association, May 2008. URL: http://www.lrec-conf.org/proceedings/lrec2008/pdf/35_paper.pdf (visited on 06/07/2017) (cit. on pp. 26, 32, 40).

TEI consortium (2020). *TEI P5: Guidelines for Electronic Text Encoding and Interchange*. Version 4.0. Guidelines. TEI consortium, 13th Feb. 2020. URL: http://www.tei-c.org/Guidelines/P5/ (visited on 09/10/2017) (cit. on pp. 5, 43).

Tellier, Isabelle, Yoann Dupont and Arnaud Courslet (2012). ‘Un segmenteur-étiqueteur et un chunker pour le français’. In: *Actes de la conférence conjointe JEP-TALN-RECITAL 2012*. TALN 2012 (Grenoble, France). Vol. 5. Association pour le Traitement Automatique des Langues, June 2012, pp. 7–8. URL: https://www.aclweb.org/anthology/F12-5004 (visited on 17/02/2020) (cit. on p. 106).

Tellier, Isabelle, Yoann Dupont, Iris Eshkol and Ilaine Wang (2013). ‘Adapt a Text-Oriented Chunker for Oral Data: How Much Manual Effort Is Necessary?’ In: *Proceedings of the 14th International Conference on Intelligent Data Engineering and Automated Learning*. IDEAL 2013, Special Session on Text Data Learning (XX, XX (Héféi, China)). Ed. by Hujun Yin, Ke Tang, Yang Gao, Frank Klawonn, Minho Lee, Thomas Weise, Bin Li and Xin Yao. Lecture Notes in Computer Science. Berlin, Heidelberg: Springer, pp. 226–233. DOI: 10.1007/978-3-642-41278-3_28. URL: https://hal.archives-ouvertes.fr/hal-01174605 (cit. on p. 106).

Tellier, Isabelle, Iris Eshkol-Taravella, Yoann Dupont and Ilaine Wang (2014). ‘Peut-on bien chunker avec de mauvaises étiquettes POS ?’ In: *Actes de la 21ème conférence sur le Traitement Automatique des Langues Naturelles*. TALN 2014. TALN2014. Marseille, France: Association pour le Traitement Automatique des Langues, July 2014, pp. 125–136. URL: https://hal.archives-ouvertes.fr/hal-01024274 (visited on 13/04/2017) (cit. on pp. 68, 106).

Telljohann, Heike, Erhard W. Hinrichs, Sandra Kübler, Heike Zinsmeister and Kathrin Beck (2006). *Stylebook for the Tübingen treebank of written German (TüBa-D/Z)*. Technical report. Tubingen, Germany: Universitat Tubingen, (cit. on pp. 39, 40).

Trouilleux, François (2001). ‘Referential links identification and automatic interpretation of pronominal expressions in French texts’. Theses. Université Blaise-Pascal, Clermont-Ferrand, Dec. 2001. URL: https://hal.archives-ouvertes.fr/tel-01152394 (visited on 12/04/2017) (cit. on pp. 36, 65, 67).

Turian, Joseph, Lev-Arie Ratinov and Yoshua Bengio (2010). ‘Word Representations: A Simple and General Method for Semi-Supervised Learning’. In: *Proceedings of the 48th Annual Meeting*
of the Association for Computational Linguistics. ACL 2010 (Uppsala, Sverige). Association for Computational Linguistics, July 2010, pp. 384–394. URL: https://www.aclweb.org/anthology/P10-1040 (visited on 16/02/2020) (cit. on p. 99).

Tutin, Agnès, François Trouilleux, Catherine Clouzot, Éric Gaussier, Annie Zaenen, Stéphanie Rayot and Georges Antoniadis (2000). ‘Annotating a large corpus with anaphoric links’. In: *Proceedings of the 3rd International Conference on Discourse Anaphora and Anaphora Resolution*. DAARC 2000. Lancaster, UK. URL: https://hal.archives-ouvertes.fr/hal-00373327 (visited on 04/09/2017) (cit. on pp. 35, 36).

Uryupina, Olga (2003). ‘High-precision Identification of Discourse New and Unique Noun Phrases’. In: *The Companion Volume to the Proceedings of 41st Annual Meeting of the Association for Computational Linguistics*. ACL 2003 (Sapporo, Japan). Association for Computational Linguistics, July 2003, pp. 80–86. DOI: 10.3115/1075178.1075189. URL: https://www.aclweb.org/anthology/P03-2012 (visited on 29/01/2020) (cit. on pp. 52, 78).

Uryupina, Olga (2004). ‘Evaluating Name-Matching for Coreference Resolution’. In: *Proceedings of the Fourth International Conference on Language Resources and Evaluation*. LREC 2004 (Lisbon, Portugal). European Language Resources Association, May 2004. URL: http://www.lrec-conf.org/proceedings/lrec2004/pdf/376.pdf (visited on 29/01/2020) (cit. on p. 52).

Uryupina, Olga (2006). ‘Coreference Resolution with and without Linguistic Knowledge’. In: *Proceedings of the Fifth International Conference on Language Resources and Evaluation*. LREC 2006 (Genova, Italia). European Language Resources Association, May 2006. URL: http://www.lrec-conf.org/proceedings/lrec2006/pdf/726 pdf.pdf (visited on 29/01/2020) (cit. on p. 52).

Uryupina, Olga (2007). ‘Knowledge acquisition for coreference resolution’. PhD Thesis. Saarbrücken, Deutschland: Universität des Saarlandes. 280 pp. DOI: http://dx.doi.org/10.22028/D291-23499. URL: https://publikationen.sulb.uni-saarland.de/handle/20.500.11880/23555 (visited on 29/01/2020) (cit. on p. 52).

Uryupina, Olga (2010). ‘Corry: A System for Coreference Resolution’. In: *Proceedings of the 5th International Workshop on Semantic Evaluation*. SemEval 2010 (Uppsala, Sverige). Association for Computational Linguistics, pp. 100–103. URL: http://dl.acm.org/citation.cfm?id=1859664.1859684 (visited on 01/03/2019) (cit. on pp. 61, 65, 89).

Uryupina, Olga, Ron Artstein, Antonella Bristot, Federica Cavicchio, Francesca Delogu, Kepa J. Rodriguez and Massimo Poesio (2019). ‘Annotating a broad range of anaphoric phenomena, in a variety of genres: the ARRAU Corpus’. In: *Natural Language Engineering* (7th May 2019), pp. 1–34. DOI: 10.1017/S1351324919000056. URL: https://www.cambridge.org/core/journals/natural-language-engineering/article/annotating-a-broad-range-of-anaphoric-phenomena-in-a-variety-of-genres-the-arrau-corpus/17E7FA2CB2E36C213E2649479593B6B0 (visited on 22/12/2019) (cit. on pp. 31, 32, 40, 64).

Uryupina, Olga, Mijail Kabadjov and Massimo Poesio (2016). ‘Detecting Non-reference and Non-anaphoricity’. In: *Anaphora Resolution: Algorithms, Resources, and Applications*. Ed. by Massimo Poesio, Roland Stuckardt and Yannick Versley. Theory and Applications of Natural Language Processing. Berlin, Heidelberg: Springer, pp. 23–54. DOI: 10.1007/978-3-662-47909-4_2. URL: https://doi.org/10.1007/978-3-662-47909-4_2 (visited on 24/11/2019) (cit. on p. 20).
Uryupina, Olga and Alessandro Moschitti (2013). 'Multilingual Mention Detection for Coreference Resolution'. In: *Proceedings of the sixth International Joint Conference on Natural Language Processing*. IJCNLP 2013 (Nagoya, Japan). Asian Federation of Natural Language Processing, Oct. 2013, pp. 100–108. URL: https://www.aclweb.org/anthology/I13-1012 (visited on 30/11/2019) (cit. on pp. 20, 32, 65).

Van Deemter, Kees and Rodger Kibble (2000). 'On Coreferring: Coreference in MUC and Related Annotation Schemes'. In: *Computational Linguistics* 26.4, pp. 629–637. URL: https://www.aclweb.org/anthology/J00-4005/ (cit. on p. 32).

Van Rijsbergen, Cornelis Joost (1979). *Information Retrieval*. Butterworth-Heinemann, 1st Jan. 1979. URL: http://dl.acm.org/citation.cfm?id=539927 (visited on 30/11/2019) (cit. on p. 20).

Vaswani, Ashish, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser and Illia Polosukhin (2017). 'Attention is All you Need'. In: *Advances in Neural Information Processing Systems* 30. Ed. by I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan and R. Garnett. Long Beach, California: Curran Associates, Inc., pp. 5998–6008. URL: http://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf (visited on 16/02/2019) (cit. on pp. 73, 83, 101).

Versley, Yannick, Simone Paolo Ponzetto, Massimo Poesio, Vladimir Eidelman, Alan Jern, Jason Smith, Xiaofeng Yang and Alessandro Moschitti (2008). 'BART: A Modular Toolkit for Coreference Resolution'. In: *Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Demo Session*. ACL-08: HLT (Columbus, Ohio, USA, 15th–20th June 2008). Association for Computational Linguistics, pp. 9–12. URL: http://dl.acm.org/citation.cfm?id=1564144.1564147 (cit. on p. 51).

Vieira, Renata and Massimo Poesio (2000). 'An Empirically-based System for Processing Definite Descriptions'. In: *Computational Linguistics* 26.4, pp. 539–593. DOI: 10.1162/089120100750105948. URL: https://www.aclweb.org/anthology/J00-4003 (visited on 29/01/2020) (cit. on pp. 52, 78).

Vilain, Marc, John Burger, John Aberdeen, Dennis Connolly and Lynette Hirschman (1995). 'A Model-Theoretic Coreference Scoring Scheme'. In: *Sixth Message Understanding Conference (MUC-6): Proceedings of a Conference Held in Columbia, Maryland, November 6-8, 1995*, pp. 45–52. URL: http://www.aclweb.org/anthology/M95-1005 (visited on 02/03/2018) (cit. on pp. 14, 21, 23).

Villemonte De La Clergerie, Éric, Benoît Sagot and Djamé Seddah (2017). 'The ParisNLP entry at the ConLL UD Shared Task 2017: A Tale of a #ParsingTragedy'. In: *Proceedings of the CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies*. CoNLL 2017 (Vancouver, Canada). Aug. 2017, pp. 243–252. DOI: 10.18653/v1/K17-3026. URL: https://hal.inria.fr/hal-01584168 (cit. on pp. 45, 107).

Vinyals, Oriol, Lukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever and Geoffrey Hinton (2015). 'Grammar As a Foreign Language'. In: *Proceedings of the 28th International Conference on Neural Information Processing* (Montreal, Canada). Vol. 2. NIPS’15. Cambridge, MA, USA: MIT Press, pp. 2773–2781. URL: http://dl.acm.org/citation.cfm?id=2969442.2969550 (visited on 16/02/2019) (cit. on p. 74).
Wan, Li, Matthew Zeiler, Sixin Zhang, Yann Le Cun and Rob Fergus (2013). 'Regularization of Neural Networks using DropConnect'. In: *International Conference on Machine Learning*. International Conference on Machine Learning. 13th Feb. 2013, pp. 1058-1066. URL: http://proceedings.mlr.press/v28/wan13.html (visited on 06/09/2019) (cit. on p. 81).

Wang, Alex, Yada Pruksachatkun, Nikita Nangia, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy and Samuel R. Bowman (2019). *SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems*. 12th July 2019. arXiv: 1905.00537 [cs]. URL: http://arxiv.org/abs/1905.00537 (visited on 30/11/2019) (cit. on p. 18).

Wang, Alex, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy and Samuel Bowman (2018). 'GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding'. In: *Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP*. BlackboxNLP 2018. Bruxelles, Belgique: Association for Computational Linguistics, pp. 353-355. DOI: 10.18653/v1/W18-5446. URL: http://aclweb.org/anthology/W18-5446 (visited on 30/11/2019) (cit. on p. 18).

Wang, Bailin, Wei Lu, Yu Wang and Hongxia Jin (2018). 'A Neural Transition-based Model for Nested Mention Recognition'. In: *Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing*. EMNLP 2018 (Brussels, Belgium). Bruxelles, Belgique: Association for Computational Linguistics, pp. 1011-1017. URL: http://aclweb.org/anthology/D18-1124 (visited on 28/02/2019) (cit. on pp. 65, 76, 94, 112).

Wang, Wenhui and Baobao Chang (2016). 'Graph-based Dependency Parsing with Bidirectional LSTM'. In: *Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics*. ACL 2016. Vol. 1. Berlin, Deutschland: Association for Computational Linguistics, pp. 2306-2315. DOI: 10.18653/v1/P16-1218. URL: http://aclweb.org/anthology/P16-1218 (visited on 21/09/2019) (cit. on p. 74).

Warde-Farley, David, Ian J. Goodfellow, Aaron Courville and Yoshua Bengio (2013). *An empirical analysis of dropout in piecewise linear networks*. 20th Dec. 2013. arXiv: 1312.6197 [cs, stat]. URL: http://arxiv.org/abs/1312.6197 (visited on 06/09/2019) (cit. on p. 81).

Webber, Bonnie Lynn (1978). 'Description Formation and Discourse Model Synthesis'. In: Theoretical Issues in Natural Language Processing-2. Urbana, Illinois, 25th July 1978. URL: https://www.aclweb.org/anthology/T78-1006 (cit. on pp. 8, 9).

Webber, Bonnie Lynn (1991). 'Structure and ostension in the interpretation of discourse deixis'. In: *Language and Cognitive Processes* 6.2 (1st Apr. 1991), pp. 107-135. DOI: 10.1080/01690969108406940. URL: https://doi.org/10.1080/01690969108406940 (visited on 24/11/2019) (cit. on p. 19).

Weber, Florence and Stéphane Beaud (2003). *Guide de l'enquête de terrain : produire et analyser des données ethnographiques*. Paris: Éditions la Découverte. 356 pp. (cit. on p. 37).

Webster, Kellie, Marta Recasens, Vera Axelrod and Jason Baldridge (2018). 'Mind the GAP: A Balanced Corpus of Gendered Ambiguous Pronouns'. In: *Transactions of the Association for Computational Linguistics* 6 (1st Dec. 2018), pp. 605-617. DOI: 10.1162/tacl_a_00240. arXiv: 1810.05201. URL: https://doi.org/10.1162/tacl_a_00240 (visited on 28/07/2020) (cit. on pp. 18, 31, 73).

Weischedel, Ralph et al. (2013). *OntoNotes release 5.0 with OntoNotes DB Tool v0.999 beta*. Dataset release LDC2013T19. Philadelphia: Linguistic Data Consortium, p. 53. URL: https://catalog.
ldc.upenn.edu/docs/LDC2013T19/OntoNotes-Release-5.0.pdf (visited on 04/08/2019)
(cit. on pp. 33, 34).

Weiss, Gail, Yoav Goldberg and Eran Yahav (2018). 'On the Practical Computational Power of Finite Precision RNNs for Language Recognition'. In: 56th Annual Meeting of the Association for Computational Linguistics. Vol. 2. Melbourne, Australia: Association for Computational Linguistics, July 2018, pp. 740–745. URL: https://www.aclweb.org/anthology/P18-2117 (visited on 23/07/2019) (cit. on pp. 71, 73, 96).

Weng, Lilian (2019). *Are Deep Neural Networks Dramatically Overfitted?* 14th Mar. 2019. URL: https://lilianweng.github.io/2019/03/14/are-deep-neural-networks-dramatically-overfitted.html (visited on 24/09/2019) (cit. on p. 81).

Weston, Jason, Sumit Chopra and Antoine Bordes (2015). 'Memory Networks'. In: *Proceedings of the 3rd International Conference on Learning Representations*. ICLR 2015 (San Diego, California, USA). 29th Nov. 2015. arXiv: 1410.3916. URL: http://arxiv.org/abs/1410.3916 (visited on 06/02/2020) (cit. on p. 57).

Widlöcher, Antoine (2008). 'Analyse macro-sémantique des structures rhétoriques du discours : cadre théorique et modèle opératoire'. thesis. Caen, 1st Jan. 2008. URL: http://www.theses.fr/2008CAEN2042 (visited on 22/01/2020) (cit. on p. 41).

Widlöcher, Antoine and Yann Mathet (2012). 'The Glozz Platform: A Corpus Annotation and Mining Tool'. In: 2012 ACM Symposium on Document Engineering. DocEng '12. New York, NY, USA: ACM, pp. 171–180. DOI: 10.1145/2361354.2361394. URL: http://doi.acm.org/10.1145/2361354.2361394 (visited on 06/07/2017) (cit. on pp. 41, 42).

Winograd, Terry (1972). 'Understanding natural language'. In: *Cognitive Psychology* 3.1 (1st Jan. 1972), pp. 1–191. DOI: 10.1016/0010-0285(72)90002-3. URL: http://www.sciencedirect.com/science/article/pii/0010028572900023 (visited on 20/02/2020) (cit. on p. 2).

Wiseman, Sam, Alexander M. Rush and Stuart M. Shieber (2016). 'Learning Global Features for Coreference Resolution'. In: *Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies*. NAACL: HLT 2016 (San Diego, California). Association for Computational Linguistics, pp. 994–1004. DOI: 10.18653/v1/N16-1114. URL: http://aclweb.org/anthology/N16-1114 (visited on 16/02/2019) (cit. on pp. 53, 57, 63, 84, 94).

Wiseman, Sam, Alexander M. Rush, Stuart M. Shieber and Jason Weston (2015). 'Learning Anaphoricity and Antecedent Ranking Features for Coreference Resolution'. In: *Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing*. ACL-IJCNLP 2015 (Beijing, China), 26th–31st July 2015). Vol. 1. Association for Computational Linguistics, pp. 1416–1426. URL: http://aclweb.org/anthology/P/P15/P15-1137.pdf (cit. on pp. 53, 61, 63, 78, 84, 109).

Wong, Catherine, Neil Houlsby, Yifeng Lu and Andrea Gesmundo (2018). 'Transfer Learning with Neural AutoML'. In: *Advances in Neural Information Processing Systems* 31. 2018 conference on Neural Information Processing Systems. Ed. by S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi and R. Garnett. Montréal, Canada: Curran Associates, Inc., 2nd Dec. 2018, pp. 8356–8365. URL: http://papers.nips.cc/paper/8056-transfer-learning-with-neural-automl.pdf (visited on 06/10/2019) (cit. on p. 93).
Yang, Xiaofeng, Jian Su, Guodong Zhou and Chew Lim Tan (2004). ‘An NP-cluster Based Approach to Coreference Resolution’. In: *Proceedings of the 20th International Conference on Computational Linguistics*. ACL 2004 (Barcelona, España). COLING ’04. Association for Computational Linguistics. DOI: 10.3115/1220355.1220388. URL: https://doi.org/10.3115/1220355.1220388 (visited on 30/01/2017) (cit. on pp. 57, 63).

Yang, Xiaofeng, Guodong Zhou, Jian Su and Chew Lim Tan (2003). ‘Coreference Resolution Using Competition Learning Approach’. In: *Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics*. ACL 2003 (Sapporo, Japan). Association for Computational Linguistics, July 2003, pp. 176–183. DOI: 10.3115/1075096.1075119. URL: https://www.aclweb.org/anthology/P03-1023 (visited on 09/02/2020) (cit. on p. 59).

Zhang, Chiyuan, Samy Bengio, Moritz Hardt, Benjamin Recht and Oriol Vinyals (2016). *Under-standing deep learning requires rethinking generalization*. 10th Nov. 2016. arXiv: 1611.03530 [cs]. URL: http://arxiv.org/abs/1611.03530 (visited on 24/09/2019) (cit. on p. 81).

Zhang, Chiyuan, Samy Bengio and Yoram Singer (2019). ‘Are All Layers Created Equal?’ In: *Proceedings of the workshop on Identifying and Understanding Deep Learning Phenomena*. 36th International Conference on Machine Learning. Long Beach, California, 5th Feb. 2019. arXiv: 1902.01996. URL: http://arxiv.org/abs/1902.01996 (visited on 06/10/2019) (cit. on p. 93).

Zhang, Rui, Cicero Nogueira dos Santos, Michihiro Yasunaga, Bing Xiang and Dragomir Radev (2018). ‘Neural Coreference Resolution with Deep Biaffine Attention by Joint Mention Detection and Mention Clustering’. In: 56th Annual Meeting of the Association for Computational Linguistics. ACL 2018. Vol. 2. Melbourne, Australia, July 2018, pp. 102–107. URL: https://aclweb.org/anthology/papers/P/P18/P18-2017/ (visited on 01/04/2019) (cit. on p. 77).

Zidouni, Azeddine, Sophie Rosset and Hervé Glotin (2010). ‘Efficient combined approach for named entity recognition in spoken language’. In: *Proceedings of the 11th Annual Conference of the International Speech Communication Association*. InterSpeech 2010 (Makuhari, Chiba, Japan). International Speech Communication Association (cit. on p. 106).

Zipf, George Kingsley (1949). *Human behavior and the principle of least effort: An introduction to human ecology*. Oxford, England: Addison-Wesley Press (cit. on p. 70).

Zoph, Barret and Quoc V. Le (2017). ‘Neural Architecture Search with Reinforcement Learning’. In: 5th International Conference on Learning Representations. Toulon, France: OpenReview.net, 26th Apr. 2017. URL: https://openreview.net/forum?id=r1Ue8Hcxg (visited on 06/10/2019) (cit. on p. 93).
List of Figures

<table><tr><td>3.1</td><td>Syntactic analysis (subtree) for “au moment où je me suis marié en juillet soixante-sept”</td><td>47</td></tr><tr><td>5.1</td><td>DeCOFre inference mode operating process</td><td>70</td></tr><tr><td>5.2</td><td>Intrinsic words representations in DeCOFre</td><td>71</td></tr><tr><td>5.3</td><td>Contextual words representations in DeCOFre</td><td>72</td></tr><tr><td>5.4</td><td>Boundaries and context embeddings in DeCOFre</td><td>74</td></tr><tr><td>5.5</td><td>Soft-head self-attention in DeCOFre</td><td>74</td></tr></table>
List of Tables

<table><tr><td>2.1</td><td>Definition of the BLANC metric</td><td>26</td></tr><tr><td>3.1</td><td>French corpora with anaphora annotations prior 2002 (from Salmon-Alt 2002)</td><td>36</td></tr><tr><td>3.2</td><td>ANCOR subcorpora dimensions (from Muzerelle et al. 2014)</td><td>37</td></tr><tr><td>5.1</td><td>Embedding dimensions in DeCOFre baseline</td><td>87</td></tr><tr><td>5.2</td><td>Feedforward networks parameters in DeCOFre baseline</td><td>88</td></tr><tr><td>5.3</td><td>Recurrent layers parameters in DeCOFre baseline</td><td>89</td></tr><tr><td>5.4</td><td>Mention detection evaluation (ANCOR test)</td><td>89</td></tr><tr><td>5.5</td><td>Coreference resolution evaluation (ANCOR test)</td><td>90</td></tr><tr><td>5.6</td><td>Influence of training setting on mention detection</td><td>90</td></tr><tr><td>5.7</td><td>Influence of the training setting on coreference resolution</td><td>91</td></tr><tr><td>5.8</td><td>Influence of the learning rate schedule on mention detection</td><td>92</td></tr><tr><td>5.9</td><td>Influence of weight decay on mention detection performances</td><td>92</td></tr><tr><td>5.10</td><td>Influence of undersampling rate on mention detection performances</td><td>93</td></tr><tr><td>6.1</td><td>Influence of the length feature on mention detection (ANCOR dev)</td><td>97</td></tr><tr><td>6.2</td><td>Influence of the length feature on coreference resolution (ANCOR dev)</td><td>97</td></tr><tr><td>6.3</td><td>Influence of string matching features on coreference resolution (ANCOR dev)</td><td>99</td></tr><tr><td>6.4</td><td>Influence of word embeddings on mention detection (ANCOR dev)</td><td>102</td></tr><tr><td>6.5</td><td>Influence of word embeddings on coreference resolution (ANCOR dev)</td><td>102</td></tr><tr><td>6.6</td><td>Influence of shallow linguistic knowledge on mention detection (ANCOR dev)</td><td>104</td></tr><tr><td>6.7</td><td>Influence of shallow linguistic knowledge on coreference resolution (ANCOR dev)</td><td>104</td></tr><tr><td>6.8</td><td>Influence of structural linguistic knowledge on mention detection (ANCOR dev)</td><td>108</td></tr><tr><td>6.9</td><td>Influence of structural linguistic knowledge on coreference resolution (ANCOR dev)</td><td>108</td></tr></table>
<figure><img src="image_9.png" /></figure>
# Licence

This document is available under the terms of the Creative Commons Attribution 4.0 International Licence (CC BY 4.0)
(https://creativecommons.org/licenses/by/4.0/deed.en)

Copyright © 2020, Loïc Grobol <loic.grobol@gmail.com>

<figure><img src="image_10.png" /></figure>

This work is part of the 'Investissements d'Avenir' overseen by the French National Research Agency ANR-10-LABX-0083 (Labex EFL), and is also supported by the ANR DEMOCRAT (Describing and Modelling Reference Chains: Tools for Corpus Annotation and Automatic Processing) project ANR-15-CE38-0008 and the ANR Profiterole (PRocessing Old French Instru-mented TExts for the Representation Of Language Evolution) project ANR-16-CE38-0010.
Reconnaissance automatique de chaînes de coréférences en français parlé

Une *chaîne de coréférences* est l'ensemble des expressions linguistiques — ou *mentions* — qui font référence à une même entité ou un même objet du discours. La tâche de reconnaissance des chaînes de coréférences consiste à détecter l'ensemble des mentions d'un document et à le partitionner en chaînes de coréférences. Ces chaînes jouent un rôle central dans la cohérence des documents et des interactions et leur identification est un enjeu important pour de nombreuses autres tâches en traitement automatique du langage, comme l'extraction d'informations ou la traduction automatique. Des systèmes automatiques de reconnaissance de chaînes de coréférence existent pour plusieurs langues, mais aucun pour le français ni pour une langue parlée.

Nous nous proposons dans cette thèse de combler ce manque par un système de reconnaissance automatique de
chaînes de coréférences pour le français parlé. À cette fin, nous proposons un système utilisant des réseaux de
neurones artificiels et ne nécessitant pas de resources externes. Ce système est viable malgré le manque d'outils de
prétraitements adaptés au français parlé et obtient des performances comparable à l'état de l'art. Nous proposons
également des voies d'amélioration de ce système, en y introduisant des connaissances issues de ressources et
d'outils conçus pour le français écrit. Enfin, nous proposons un nouveau format de représentation pour l'annotation
des chaînes de coréférences dans des corpus de langues écrites et parlées et en nous en donnons un exemple en
proposant under nouvelle version d'ANCOR — le premier corpus de français annoté en coréférence.

Mots-clés : anaphore, coréférence, réseaux de neurones artificiels, apprentissage artificiel, ressources annotées, corpus, formats d'annotation, traitement automatique du langage naturel

Coreference resolution for spoken French

A *coreference chain* is the set of linguistic expressions — or *mentions* — that refer to the same entity or discourse object in a given document. *Coreference resolution* consists in detecting all the mentions in a document and partitioning their set in coreference chains. Coreference chains play a central role in the consistency of documents and interactions, and their identification has applications to many other fields in natural language processing that rely on understanding of language, such as information extraction, question answering or machine translation. Natural language processing systems that perform this task exist for many languages, but none for French — which suffered until recently from a lack of suitable annotated resources — and none for spoken language.

In this thesis, we aim to fill this lack by designing a coreference resolution system for spoken French. To this end,
we propose a knowledge-poor system based on an end-to-end neural network architecture, which obviates the need
for the preprocessing pipelines common in existing systems, while maintaining performances comparable to the
state-of-the art. We then propose extensions on that baseline, by augmenting our system with external knowledge
obtained from resources and preprocessing tools designed for written French. Finally, we propose a new standard
representation for coreference annotation in corpora of written and spoken languages, and demonstrate its use in a
new version of ANCOR, the first coreference corpus of spoken French.

**Keywords:** anaphora, coreference, artificial neural networks, machine learning, annotated resources, corpus, annotations representation, natural language processing

École Doctorale 622 — Sciences du Langage,
Université Sorbonne Nouvelle, maison de la recherche
4, rue des Irlandais, 75005 Paris