[1] AMBA HOMBAIAH, S., CHEN, T., ZHANG, M., BENDERSKY, M., AND NAJORK, M. Dynamic language models for continuously evolving content. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining (2021), pp. 2514-2524.
[2] BERT, S. stackexchange, 2021.
[3] CHEN, X., FANG, H., LIN, T.-Y., VEDANTAM, R., GUPTA, S., DOLLÁR, P., AND ZIT-NICK, C. L. Microsoft coco captions: Data collection and evaluation server. arXiv preprint arXiv:1504.00325 (2015).
[4] EHRMANN, M., HAMDI, A., PONTES, E. L., ROMANELLO, M., AND DOUCET, A. Named entity recognition and classification in historical documents: A survey. ACM Computing Surveys (2021).
[5] ETHAYARAJH, K. How contextual are contextualized word representations? comparing the geometry of bert, elmo, and gpt-2 embeddings. arXiv preprint arXiv:1909.00512 (2019).
[6] FADER, A., ZETTLEMOYER, L., AND ETZIONI, O. Open question answering over curated and extracted knowledge bases. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining (2014), pp. 1156-1165.
[7] FALKNER, S., KLEIN, A., AND HUTTER, F. BOHB: Robust and efficient hyperparameter optimization at scale. In Proceedings of the 35th International Conference on Machine Learning (10-15 Jul 2018), J. Dy and A. Krause, Eds., vol. 80 of Proceedings of Machine Learning Research, PMLR, pp. 1437-1446.
[8] GUARNERI, J. Newsprint Metropolis. University of Chicago Press, 2017.
[9] HADSELL, R., CHOPRA, S., AND LECUN, Y. Dimensionality reduction by learning an invariant mapping. In 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06) (2006), vol. 2, IEEE, pp. 1735-1742.
[10] HE, K., GKIOXARI, G., DOLLÁR, P., AND GIRSHICK, R. Mask r-cnn. Proceedings of the IEEE international conference on computer vision (2017), 2961-2969.
[11] HENDERSON, M., BUDZIANOWSKI, P., CASANUEVA, I., COOPE, S., GERZ, D., KUMAR, G., MRKSIC, N., SPITHOURAKIS, G., SU, P.-H., VULIC, I., ET AL. A repository of conversational datasets. In Proceedings of the First Workshop on NLP for Conversational AI (2019), pp. 1-10.
[12] IYER, S., DANDEKAR, N., AND CSERNAI, K. First quora dataset release: Question pairs, 2017.
[13] JOHNSON, J., DOUZE, M., AND JÉGOU, H. Billion-scale similarity search with gpus. IEEE Transactions on Big Data 7, 3 (2019), 535-547.
[14] LIU, Y., OTT, M., GOYAL, N., DU, J., JOSHI, M., CHEN, D., LEVY, O., LEWIS, M., ZETTLEMOYER, L., AND STOYANOV, V. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019).
[15] LOUREIRO, D., BARBIERI, F., NEVES, L., ANKE, L. E., AND CAMACHO-COLLADOS, J. Timelms: Diachronic language models from twitter. arXiv preprint arXiv:2202.03829 (2022).
[16] MANJAVACAS, E., AND FONTEYN, L. Macberth: Development and evaluation of a historically pre-trained language model for english (1450-1950). In Proceedings of the Workshop on Natural Language Processing for Digital Humanities (2021), pp. 23-36.
[17] MANJAVACAS, E., AND FONTEYN, L. Adapting vs. pre-training language models for historical languages. Journal of Data Mining & Digital Humanities, Digital humanities in languages (2022).
[18] MUENNIGHOFF, N., TAZI, N., MAGNE, L., AND REIMERS, N. Mteb: Massive text embedding benchmark. arXiv preprint arXiv:2210.07316 (2022).