datasets-CNRS/ThesoTM huggingface dataset:
ABLTagger / ABLTagger
Definition: A part-of-speech tagger for Icelandic.
Définition : Etiqueteur morphosyntaxique pour l'islandais.
Broader concept: Python library / librairie Python
Application field: generic / générique
Tasks performed: lemmatization§§PoS tagging / lemmatisation§§étiquetage morpho-syntaxique
Implements: bidirectional long-short term memory / mémoire court et long terme bidirectionnelle
Input languages: Icelandic / islandais
Input data: .txt
Programming language: Python
Platforms: Linux§§Windows§§macOS
Interface: command-line interface / interface en ligne de commande
Design country: Iceland / Islande
Licence: Apache License Version 2.0 / Apache License Version 2.0
Repository: https://github.com/steinst/ABLTagger
Reference: Steingrímsson, S., Kárason, Ö., & Loftsson, H. (2019). Augmenting a BiLSTM tagger with a Morphological Lexicon and a Lexical Category Identification Step (arXiv:1907.09038). arXiv. https://doi.org/10.48550/arXiv.1907.09038
ABNER / ABNER
Definition: ABNER is an open source software tool for molecular biology text analysis (genes, proteins tagging...)
Définition : ABNER est un outil logiciel open source pour l'analyse de textes en biologie moléculaire (marquage de gènes, protéines...).
Broader concept: software application / application logicielle
Application field: biology§§medicine / biologie§§médecine
Tasks performed: named entity recognition§§tokenization / reconnaissance d'entités nommées§§tokenisation
Input languages: English / anglais
Input data: .txt
Programming language: Java
Platforms: Linux§§Solaris§§Windows§§macOS
Interface: graphical user interface§§application programming interface / interface utilisateur graphique§§interface de programmation d’application
Design country: United States / États-Unis
Licence: open source software license / licence de logiciel libre
Reference: Settles, B. (2005). ABNER : An open source tool for automatically tagging genes, proteins and other entity names in text. Bioinformatics, 21(14), 3191‑3192. https://doi.org/10.1093/bioinformatics/bti475
AFINN / AFINN
Definition: Sentiment analysis with Python.
Définition : Analyse de sentiments avec Python.
Broader concept: Python library / librairie Python
Application field: generic / générique
Tasks performed: sentiment analysis / analyse de sentiments
Input languages: Danish§§English§§Finnish§§Polish§§Swedish§§Turkish / danois§§anglais§§finnois§§polonais§§suédois§§turc
Input data: .txt
Programming language: Python
Platforms: Linux§§Windows§§macOS
Interface: command-line interface / interface en ligne de commande
Design country: Danemark / Danemark
Licence: Apache License Version 2.0 / Apache License Version 2.0
Repository: https://github.com/fnielsen/afinn
Reference: Finn Årup Nielsen, "A new ANEW: evaluation of a word list for sentiment analysis in microblogs", Proceedings of the ESWC2011 Workshop on 'Making Sense of Microposts': Big things come in small packages. Volume 718 in CEUR Workshop Proceedings: 93-98. 2011 May. Matthew Rowe, Milan Stankovic, Aba-Sah Dadzie, Mariann Hardey (editors)
AFNER / AFNER
Definition: AFNER is a C++ named entity recognition system that uses machine learning techniques. It is customisable to various domains. It also allows for multiple and overlapping named entity labels.
Définition : AFNER est un système de reconnaissance d'entités nommées en C++ qui utilise des techniques d'apprentissage automatique. Il est adaptable à différents domaines. Il permet l'attribution d'étiquettes d'entités nommées multiples et chevauchantes.
Broader concept: C++ library / librairie C++
Application field: generic / générique
Tasks performed: named entity recognition§§tokenization / reconnaissance d'entités nommées§§tokenisation
Implements: maximum entropy / entropie maximale
Programming language: C++
Interface: command-line interface§§application programming interface / interface en ligne de commande§§interface de programmation d’application
Design country: Australia / Australie
Licence: free to use license / licence libre d'utilisation
ALBERT / ALBERT
Also known as: A Lite Bidirectional Encoder Representations from Transformers§§A little BERT / 
Definition: A BERT architecture with fewer parameters.
Définition : Une architecture BERT avec un nombre limité de paramètres.
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Input languages: Chinese§§English / chinois§§anglais
Programming language: Python
Design country: United States / États-Unis
Licence: Apache License Version 2.0 / Apache License Version 2.0
Based on: BERT§§transformer / BERT§§transformeur
Base of: Czert-A§§FARM§§IndicBERT§§KoreALBERT§§Spark NLP§§Spark NLP Python§§Spark NLP Scala / Czert-A§§FARM§§IndicBERT§§KoreALBERT§§Spark NLP§§Spark NLP Python§§Spark NLP Scala
Repository: https://github.com/google-research/ALBERT
Reference: Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019). ALBERT : A Lite BERT for self-supervised learning of language representations. https://arxiv.org/abs/1909.11942v6
ALUM / ALUM
Also known as: Adversarial training for large neural LangUage Models / 
Definition: Language model "which regularizes the training objective by applying perturbations in the embedding space that maximizes the adversarial loss" (Liu et al., 2020).
Définition : Modèle de langage qui « régularise l'entraînement en appliquant des perturbations dans l'espace des embeddings qui maximise la perte antagoniste » (Liu et al., 2020).
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Implements: generative adversarial network / réseau antagoniste génératif
Input languages: English / anglais
Programming language: Python
Repository: https://github.com/namisan/mt-dnn
Reference: Liu, X., Cheng, H., He, P., Chen, W., Wang, Y., Poon, H., & Gao, J. (2020). Adversarial training for large neural language models. arXiv:2004.08994 [cs]. http://arxiv.org/abs/2004.08994
ALeaseBERT / ALeaseBERT
Definition: A BERT model for lease contracts.
Définition : Modèle BERT pour les contracts de location.
Broader concept: large language model / grand modèle de langue
Application field: legal information / information légale
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Input languages: Dutch / néerlandais
Programming language: Python
Design country: Netherlands / Pays-Bas
Based on: BERT / BERT
Repository: https://gitlab.com/spyretta.leiv/lease_contract_review
Reference: Leivaditi, S., Rossi, J., & Kanoulas, E. (2020). A benchmark for lease contract review. arXiv:2010.10386 [cs]. http://arxiv.org/abs/2010.10386
ARBERT / ARBERT
Definition: A BERT model for Arabic.
Définition : Modèle BERT pour l'arabe.
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Input languages: Arabic / arabe
Programming language: Python
Design country: United States / États-Unis
Based on: BERT / BERT
Repository: https://github.com/UBC-NLP/marbert
Reference: Abdul-Mageed, M., Elmadany, A., & Nagoudi, E. M. B. (2021). ARBERT & MARBERT : Deep bidirectional transformers for Arabic. arXiv:2101.01785 [cs]. http://arxiv.org/abs/2101.01785
AbLang / AbLang
Definition: "A language model for antibodies" (source: https://github.com/oxpig/AbLang).
Définition : Modèle de langue sur les anticorps.
Broader concept: large language model / grand modèle de langue
Application field: biology§§medicine / biologie§§médecine
Implements: transformer / transformeur
Programming language: Python
Design country: United Kingdom / Royaume-Uni
Licence: GNU GPL v3 / GNU GPL v3
Repository: https://github.com/oxpig/AbLang
Reference: Olsen, T. H., Moal, I. H., & Deane, C. M. (2022). AbLang : An antibody language model for completing antibody sequences. Bioinformatics Advances, 2(1), vbac046. https://doi.org/10.1093/bioadv/vbac046
Abkhazian / abkhaze
Also known as: Abkhaz§§Abxaz / 
Broader concept: natural language / langage naturel
IETF language tag: ab
ISO 639-1: ab
ISO 639-2: abk
ISO 639-3: abk
academic information / information académique
Broader concept: knowledge area / domaine de connaissance
Application field of: OAG-BERT§§S4§§VosViewer§§srBERT / OAG-BERT§§S4§§VosViewer§§srBERT
Acehnese / achinais
Also known as:  / aceh§§acehnais
Broader concept: natural language / langage naturel
IETF language tag: ace
ISO 639-2: ace
ISO 639-3: ace
AdaGram.jl / AdaGram.jl
Also known as: adaptive skip-gram / 
Definition: Adaptive Skip-gram implementation in Julia.
Définition : Implémentation du skip-gram adaptatif en Julia.
Broader concept: Julia library / librairie Julia
Application field: generic / générique
Tasks performed: word embedding§§word sense disambiguation / plongement lexical§§désambiguïsation du sens des mots
Implements: Word2Vec / Word2Vec
Programming language: Julia
Platforms: Linux§§Windows§§macOS
Interface: command-line interface§§application programming interface / interface en ligne de commande§§interface de programmation d’application
Design country: Russia / Russie
Licence: MIT License / licence MIT
Base of: AdaGram Python / AdaGram Python
Repository: https://github.com/sbos/AdaGram.jl
Reference: Bartunov, S., Kondrashkin, D., Osokin, A., & Vetrov, D. (2015). Breaking sticks and ambiguities with adaptive skip-gram. https://doi.org/10.48550/arXiv.1502.07257
AdaGram Python / AdaGram Python
Definition: AdaGram (adaptive skip-gram) for Python.
Définition : Implémentation d'Adagram en Python.
Broader concept: Python library / librairie Python
Application field: generic / générique
Tasks performed: word embedding§§word sense disambiguation / plongement lexical§§désambiguïsation du sens des mots
Implements: Word2Vec / Word2Vec
Programming language: Julia§§C§§Python
Platforms: Linux§§Windows§§macOS
Design country: United Kingdom / Royaume-Uni
Based on: AdaGram.jl / AdaGram.jl
Repository: https://github.com/lopuhin/python-adagram
Adaboost / Adaboost
Also known as: adaptative boosting / boosting adaptatif
Definition: AdaBoost is a statistical classification meta-algorithm used in conjunction with many other types of learning algorithms to improve performance. (Wikipedia, retrieved on 2021/07/07).
Définition : AdaBoost est un méta-algorithme de classification statistique utilisé conjointement avec de nombreux autres types d'algorithmes d'apprentissage pour améliorer les performances. (Wikipédia, récupéré le 07/07/2021).
Broader concept: boosting / boosting
Implemented by: Datumbox§§RWeka§§scikit-learn / Datumbox§§RWeka§§scikit-learn
Reference: Freund, Y., & Schapire, R. E. (1997). A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting. Journal of Computer and System Sciences, 55(1), 119‑139. https://doi.org/10.1006/jcss.1997.1504
additive regularization of topic models / régularisation additive de modèles de topiques
Broader concept: topic modelling algorithm / algorithme de modélisation de topiques
Implemented by: BigARTM / BigARTM
Reference: Vorontsov, K., & Potapenko, A. (2015). Additive regularization of topic models. Machine Learning, 101(1), 303–323. https://doi.org/10.1007/s10994-014-5476-6
affinity propagation / propagation d'affinités
Broader concept: clustering algorithm / algorithme de partitionnement
Implemented by: scikit-learn / scikit-learn
Afrikaans / afrikaans
Broader concept: natural language / langage naturel
IETF language tag: af
ISO 639-1: af
ISO 639-2: afr
ISO 639-3: afr
agglomerative clustering / partitionnement agglomératif
Also known as: agglomerative hierarchical clustering / clustering agglomératif§§partitionnement hiérarchique agglomératif
Broader concept: hierarchical clustering / partitionnement hiérarchique
Implemented by: scikit-learn / scikit-learn
Aguaruna / aguaruna
Broader concept: natural language / langage naturel
IETF language tag: agr
ISO 639-3: agr
Aika / Aika
Definition: Java library that automatically extracts and annotates semantic information into text.
Définition : Librairie Java qui extrait et annote automatiquement des informations sémantiques dans le texte.
Broader concept: Java library / librairie Java
Application field: generic / générique
Tasks performed: information extraction§§named entity recognition§§text annotation§§text categorization§§word sense disambiguation / extraction d'information§§reconnaissance d'entités nommées§§annotation textuelle§§catégorisation de textes§§désambiguïsation du sens des mots
Implements: classification algorithm§§Neural networks models / algorithme de classification§§modèles de réseaux de neurones
Input languages: English / anglais
Programming language: Java
Interface: command-line interface§§application programming interface / interface en ligne de commande§§interface de programmation d’application
Design country: Germany / Allemagne
Licence: Apache License Version 2.0 / Apache License Version 2.0
Repository: https://github.com/aika-algorithm/aika
Aja / aja
Also known as: Adja / aja-gbe
Broader concept: natural language / langage naturel
IETF language tag: ajg
ISO 639-3: ajg
Akan / akan
Broader concept: natural language / langage naturel
IETF language tag: ak
ISO 639-1: ak
ISO 639-2: aka
ISO 639-3: aka
AlBERTo / AlBERTo
Definition: A BERT language model for Italian trained on social medias, especially on Twitter.
Définition : Modèle de langage basé sur BERT et entrainé sur des médias sociaux, plus spécifiquement sur Twitter.
Broader concept: large language model / grand modèle de langue
Application field: social networks / réseaux sociaux
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Input languages: Italian / italien
Programming language: Python
Design country: Italy / Italie
Based on: BERT / BERT
Repository: https://github.com/marcopoli/AlBERTo-it
Reference: Polignano, M., Basile, P., & de Gemmis, M. (s. d.). Alberto : Italian bert language understanding model for NLP challenging tasks based on tweets. 6. http://ceur-ws.org/Vol-2481/paper57.pdf§§Polignano, M., Basile, V., Basile, P., de Gemmis, M., & Semeraro, G. (2019). AlBERTo : Modeling Italian Social Media Language with BERT. IJCoL. Italian Journal of Computational Linguistics, 5(2), 11‑31. https://doi.org/10.4000/ijcol.472
Albanian / albanais
Broader concept: natural language / langage naturel
IETF language tag: sq
ISO 639-1: sq
ISO 639-2: alb§§sqi
Alemannic / alémanique
Also known as: Alemannish / 
Broader concept: German / allemand
IETF language tag: gsw
ISO 639-2: gsw
ISO 639-3: gsw
AlephBERT / AlephBERT
Definition: A BERT language model for modern Hebrew.
Définition : Modèle de langue basé sur BERT pour l'hébreu moderne.
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Input languages: Hebrew / hébreu
Programming language: Python
Licence: Apache License Version 2.0 / Apache License Version 2.0
Based on: BERT / BERT
Repository: https://github.com/OnlpLab/AlephBERT
Reference: Seker, A., Bandel, E., Bareket, D., Brusilovsky, I., Greenfeld, R. S., & Tsarfaty, R. (2021). AlephBERT:a Hebrew large pre-trained language model to start-off your hebrew NLP application with. https://doi.org/10.48550/arXiv.2104.04052
AllenNLP / AllenNLP
Definition: An open-source NLP research library, built on PyTorch.
Définition : Librairie libre NLP construite sur PyTorch.
Broader concept: Python library / librairie Python
Application field: generic / générique
Tasks performed: semantic role labeling§§word embedding§§coreference resolution§§constituency parsing§§dependency parsing§§information extraction§§named entity recognition§§Question Answering§§sentiment analysis§§tokenization / étiquetage en rôles sémantiques§§plongement lexical§§résolution de coréférence§§analyse en constituants§§analyse en dépendances§§extraction d'information§§reconnaissance d'entités nommées§§système de questions réponses§§analyse de sentiments§§tokenisation
Input languages: English / anglais
Input data: .txt
Programming language: Python
Platforms: Linux§§macOS
Design country: United States / États-Unis
Licence: Apache License Version 2.0 / Apache License Version 2.0
Reference: Gardner, M., Grus, J., Neumann, M., Tafjord, O., Dasigi, P., Liu, N.F., Peters, M.E., Schmitz, M., & Zettlemoyer, L. (2018). AllenNLP: A Deep Semantic Natural Language Processing Platform. ArXiv, abs/1803.07640.
Alsatian / alsacien
Broader concept: Alemannic / alémanique
IETF language tag: gsw-FR
ISO 639-3: gsw
Alvis NLP / Alvis NLP
Definition: Alvis NLP is a corpus processing engine for Natural Language Processing which automates sequences of NLP and machine learning steps.
Définition : Alvis NLP est un moteur de traitement de corpus pour le langage naturel qui automatise les étapes de traitement et d''apprentissage automatique.
Broader concept: software application / application logicielle
Application field: generic / générique
Tasks performed: information retrieval§§named entity recognition§§PoS tagging§§Question Answering§§sentiment analysis§§stemming / recherche d'information§§reconnaissance d'entités nommées§§étiquetage morpho-syntaxique§§système de questions réponses§§analyse de sentiments§§racinisation
Input languages: Chinese§§English§§French§§Slovenian / chinois§§anglais§§français§§slovène
Input data: .txt
Programming language: Java§§JavaScript§§Python
Platforms: Linux
Design country: France§§Germany / Allemagne§§France
Licence: Apache License Version 2.0 / Apache License Version 2.0
Repository: https://github.com/Bibliome/alvisnlp
Reference: Ba M. & Bossy R. Interoperability Of Corpus Processing Work-Flow Engines: The Case Of Alvisnlp/Ml In Openminted, (2016), https://core.ac.uk/reader/144773106§§Chaix E., Deléger L., Bossy R. & Nédellec C. Text mining tools for extracting information about microbial biodiversity in food, (2019), Food Microbiology 81, 63-75 , https://doi.org/10.1016/j.fm.2018.04.011§§Julien Derivière, Thierry Hamon, Adeline Nazarenko, (2006), Advances in Natural Language Processing, vol. 4139, pp. 56-67§§Toader Gherasim, Mounira Harzallah, Giuseppe Berio, Pascale Kuntz, (2013), Advances in Knowledge Discovery and Management, vol. 471, pp. 177-201. https://hal.archives-ouvertes.fr/hal-00911868
Amahuaca / amahuaca
Broader concept: natural language / langage naturel
ISO 639-3: amc
Amarakaeri / amarakaeri
Also known as:  / amaracaire§§amarakaire§§mashco
Broader concept: natural language / langage naturel
IETF language tag: amr
ISO 639-3: amr
AmbiverseNLU / AmbiverseNLU
Definition: A natural language understanding suite.
Définition : Suite d'outils de traitement automatique du langage.
Broader concept: Java library / librairie Java
Application field: generic / générique
Tasks performed: entity linking§§information extraction§§named entity recognition / résolution référentielle d'entité§§extraction d'information§§reconnaissance d'entités nommées
Input languages: Chinese§§Czech§§English§§German§§Russian§§Spanish / chinois§§tchèque§§anglais§§allemand§§russe§§espagnol
Programming language: Java
Interface: command-line interface / interface en ligne de commande
Design country: Germany / Allemagne
Licence: Apache License Version 2.0 / Apache License Version 2.0
Repository: https://github.com/ambiverse-nlu/ambiverse-nlu
Amharic / amharique
Broader concept: natural language / langage naturel
IETF language tag: am
ISO 639-1: am
ISO 639-2: amh
ISO 639-3: amh
Analec / Analec
Definition: Analec is a software for annotation and analysis of writen corpora.
Définition : Analec est un logiciel d'annotation et d'analyse de corpus écrits.
Broader concept: software application / application logicielle
Application field: generic / générique
Tasks performed: concordance analysis§§corpus analysis§§text annotation§§visualization / analyse de concordance§§analyse de corpus§§annotation textuelle§§visualisation
Input languages: French / français
Input data: .txt
Programming language: Java
Platforms: Linux§§non-specified UNIX§§Windows§§macOS
Interface: desktop graphical user interface / interface utilisateur graphique desktop
Design country: France / France
Licence: GNU GPL v3 / GNU GPL v3
Reference: Frédéric Landragin, Thierry Poibeau, Bernard Victorri ANALEC : a New Tool for the Dynamic Annotation of Textual Data, (2012), International Conference on Language Resources and Evaluation (LREC 2012), Istanbul, Turkey. pp.357-362. https://halshs.archives-ouvertes.fr/halshs-00698971
ANALHITZA / ANALHITZA
Definition: Information extraction tool.
Définition : Outil d'extraction d'informations.
Broader concept: software application / application logicielle
Application field: generic / générique
Tasks performed: collocation§§information extraction§§named entity recognition / collocation§§extraction d'information§§reconnaissance d'entités nommées
Input languages: Basque§§English§§Spanish / basque§§anglais§§espagnol
Input data: .txt
Interface: web user interface / interface utilisateur web
Design country: Spain / Espagne
Licence: free to use license / licence libre d'utilisation
Reference: Otegi, A., Imaz, O., de Ilarraza, A. D., & Iruskieta, M. (n.d.). ANALHITZA: a tool to extract linguistic information from large corpora in Humanities research. 8.
anaphora resolution / résolution d'anaphore
Definition: The problem of resolving what a pronoun, or a noun phrase refers to.
Définition : Résolution de ce à quoi se réfère un pronom, ou une expression nominale.
Broader concept: linguistic analysis / analyse linguistique
Scope note: The problem of resolving what a pronoun, or a noun phrase refers to.
Android / Android
Broader concept: Linux / Linux
Related: SentiStrength§§TreeTagger§§YAKE / SentiStrength§§TreeTagger§§YAKE
AntConc / AntConc
Definition: Antconc is a freeware corpus analysis toolkit for concordancing and text analysis.
Définition : Antconc est une boîte à outils libre d'analyse de corpus faisant office de concordancier et permettant l'analyse de textes.
Broader concept: software application / application logicielle
Application field: generic / générique
Tasks performed: concordance analysis§§collocation / analyse de concordance§§collocation
Input languages: French§§Spanish / français§§espagnol
Input data: .txt
Programming language: Perl
Platforms: Linux§§Windows§§macOS
Interface: graphical user interface / interface utilisateur graphique
Design country: Japan / Japon
Licence: proprietary commercial software license§§free to use license / licence de logiciel commercial propriétaire§§licence libre d'utilisation
Ao / ao
Broader concept: natural language / langage naturel
IETF language tag: njo
ISO 639-3: njo
Apache UIMA / Apache UIMA
Definition: Apache UIMa is a component software architecture for the development, discovery, composition, and deployment of multi-modal analytics for the analysis of unstructured information and integration with search technologies.
Définition : Apache UIMA est une architecture logicielle pour le développement, la découverte, la composition et le déploiement d'analyses multimodales, pour l'analyse d'informations non structurées et l'intégration avec les technologies de recherche.
Broader concept: software application / application logicielle
Application field: generic / générique
Tasks performed: support operation / opération support
Programming language: Java
Design country:  / États-Unis
Licence: Apache License Version 2.0 / Apache License Version 2.0
Is software for: Apache cTAKES§§Argo§§Rasp§§Termsuite / Apache cTAKES§§Argo§§Rasp§§Termsuite
Reference: Andreas Holzinger, Christof Stocker, Bernhard Ofner, Gottfried Prohaska, Alberto Brabenetz, Rainer Hofmann-Wellenhof Human-Computer Interaction and Knowledge Discovery in Complex, Unstructured, Big Data, (2013), vol.7947, pp.13-24. https://doi.org/10.1007/978-3-642-39146-0_2