datasets-CNRS/ThesoTM huggingface dataset:
FreeLing / FreeLing
Definition: Freeling is an open-source suite of language analyzers.
Définition : Freeling est une suite d'analyseurs de langues dont le code source est libre.
Broader concept: C++ library / librairie C++
Application field: generic / générique
Tasks performed: semantic role labeling§§coreference resolution§§dependency parsing§§morphological analysis§§named entity recognition§§PoS tagging§§sentence splitting§§tokenization§§word sense disambiguation / étiquetage en rôles sémantiques§§résolution de coréférence§§analyse en dépendances§§analyse morphologique§§reconnaissance d'entités nommées§§étiquetage morpho-syntaxique§§découpage de phrases§§tokenisation§§désambiguïsation du sens des mots
Input languages: Asturian§§Catalan§§English§§French§§Galician§§German§§Italian§§Norwegian§§Portuguese§§Russian§§Slovenian§§Spanish§§Welsh / asturien§§catalan§§anglais§§français§§galicien§§allemand§§italien§§norvégien§§portugais§§russe§§slovène§§espagnol§§gallois
Programming language: C++
Platforms: Linux§§Windows§§macOS
Interface: command-line interface / interface en ligne de commande
Design country: Spain / Espagne
Licence: GNU AGPL / GNU AGPL
Repository: https://github.com/TALP-UPC/FreeLing
Reference: Iria da Cunha, Eric SanJuan, Juan-Manuel Torres-Moreno, Marina Lloberes, Irene Castellón Discourse Segmentation for Spanish Based on Shallow Parsing, (2010), Advances in Artificial Intelligence, vol. 6437, pp. 13-23. https://doi.org/10.1007/978-3-642-16761-4_2§§Lorenza Moreno-Monteagudo, Rubén Izquierdo-Beviá, Patricio Martínez-Barco, Armando Suárez A Study of the Influence of PoS Tagging on WSD, (2006), Text, Speech and Dialogue, vol. 4188, pp. 173-179. https://doi.org/10.1007/11846406_22
French / français
Broader concept: natural language / langage naturel
IETF language tag: fr
ISO 639-1: fr
ISO 639-2: fra§§fre
ISO 639-3: fra
Frisian / langue frisonne
Broader concept: natural language / langage naturel
IETF language tag: fy§§stq
ISO 639-1: fy
ISO 639-3: fy
Friulian / frioulan
Also known as: Friulan / ladin oriental
Broader concept: natural language / langage naturel
IETF language tag: fur
ISO 639-2: fur
ISO 639-3: fur
FuzzyTM / FuzzyTM
Definition: A Python library to train Fuzzy Latent Semantic Analysis-based topic models.
Définition : Librairie Python pour entraîner des modèles de topiques basés sur l'analyse sémantique latente floue.
Broader concept: Python library / librairie Python
Application field: generic / générique
Tasks performed: topic detection / identification de topics
Implements: latent semantic analysis / analyse sémantique latente
Programming language: Python
Platforms: Linux§§Windows§§macOS
Interface: command-line interface / interface en ligne de commande
Design country: Netherlands / Pays-Bas
Licence: GNU GPL v3 / GNU GPL v3
Repository: https://pypi.org/project/FuzzyTM/
GATE / GATE
Also known as: General Architecture for Text Engineering / 
Definition: GATE is a suite of tools written in Java, used for human language processing, analysis, and information extraction.
Définition : GATE est une suite d'outils en Java, utilisés pour le traitement du langage, l'analyse et l'extraction d'informations.
Broader concept: software application / application logicielle
Application field: generic / générique
Tasks performed: annotation§§chunking§§coreference resolution§§information extraction§§morphological analysis§§named entity recognition§§PoS tagging§§sentence splitting§§text categorization§§tokenization§§topic detection / annotation§§chunking§§résolution de coréférence§§extraction d'information§§analyse morphologique§§reconnaissance d'entités nommées§§étiquetage morpho-syntaxique§§découpage de phrases§§catégorisation de textes§§tokenisation§§identification de topics
Implements: decision tree§§latent Dirichlet allocation§§logistic regression§§naive Bayes classifier§§support vector machine§§Neural networks models / arbre de décision§§allocation de Dirichlet latente§§régression logistique§§classifieur bayésien naïf§§machine à vecteurs de support§§modèles de réseaux de neurones
Input languages: Arabic§§Bulgarian§§Cebuano§§Chinese§§Danish§§English§§French§§German§§Hindi§§Italian§§Romanian§§Russian / arabe§§bulgare§§cebuano§§chinois§§danois§§anglais§§français§§allemand§§hindi§§italien§§roumain§§russe
Input data: .txt§§XML
Programming language: Java
Platforms: Linux§§Windows§§macOS
Interface: graphical user interface§§command-line interface§§application programming interface / interface utilisateur graphique§§interface en ligne de commande§§interface de programmation d’application
Design country: United Kingdom / Royaume-Uni
Licence: GNU LGPL v3 / GNU LGPL v3
Uses software: MALLET / MALLET
Reference: Cunningham H., Tablan V., Roberts A., Bontcheva K. Getting More Out of Biomedical Documents with GATE's Full Lifecycle Open Source Text Analytics, (2013), PLoS Comput Biol 9(2): e1002854. https://doi.org/10.1371/journal.pcbi.1002854
GLoVe / GLoVe
Definition: GloVe is an unsupervised learning algorithm for obtaining vector representations for words.
Définition : GloVe est un algorithme d'apprentissage non supervisé pour obtenir des représentations vectorielles de mots.
Broader concept: algorithm / algorithme
Programming language: C
Licence: Apache License Version 2.0 / Apache License Version 2.0
Implemented by: FasTag§§Flair§§GloVe jl§§Glowe.jl§§GluonNLP§§Polyglot§§Spark NLP§§Spark NLP Python§§Spark NLP Scala§§TextTinyR§§PyTorch-NLP§§text2vec§§wordVectors / FasTag§§Flair§§GloVe.jl§§Glowe.jl§§GluonNLP§§Polyglot§§Spark NLP§§Spark NLP Python§§Spark NLP Scala§§TextTinyR§§PyTorch-NLP§§text2vec§§wordVectors
Repository: https://github.com/stanfordnlp/GloVe
Reference: Pennington, J., Socher, R., & Manning, C. (2014). GloVe: Global vectors for word representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 1532–1543. https://doi.org/10.3115/v1/D14-1162
GNormPlus / GNormPlus
Definition: GNormPlus enables an integrative approach to labeling of genes, gene families and protein domains.
Définition : GNormPlus permet une approche intégrative pour l'étiquetage des gènes, des familles de gènes et des domaines protéiques.
Broader concept: Java library / librairie Java
Application field: biology / biologie
Tasks performed: named entity recognition / reconnaissance d'entités nommées
Input languages: English / anglais
Input data: XML
Programming language: Java§§Perl
Interface: command-line interface§§application programming interface / interface en ligne de commande§§interface de programmation d’application
Design country: Taiwan§§United States / Taïwan§§États-Unis
Licence: free to use license / licence libre d'utilisation
Reference: Wei, C.-H., Kao, H.-Y., & Lu, Z. (2015, août 25). Gnormplus : An integrative approach for tagging genes, gene families, and protein domains [Research Article]. BioMed Research International; Hindawi. https://doi.org/10.1155/2015/918710
GPT / GPT
Also known as: GPT-1§§GPT-n§§generative pre-trained transformer / GPT-1§§GPT-n
Definition: Language model based on transformers and unsupervised learning.
Définition : Modèle de langage basé sur les transformeurs et l'apprentissage non supervisé.
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Design country: United States / États-Unis
Base of: GPT-2§§GPT-3§§GenSLMs / GPT-2§§GPT-3§§GenSLMS
Reference: Radford, A., Narasimhan, K., Salimans, T., & Sutskever, I. Improving language understanding by generative pre-training. https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf
GPT-2 / GPT-2
Also known as: Generative Pre-trained Transformer 2 / 
Definition: Second-generation of the GPT language model.
Définition : Deuxième génération du modèle de langage GPT.
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Programming language: Python
Design country: United States / États-Unis
Licence: MIT License / licence MIT
Based on: GPT / GPT
Base of: AraGPT2§§CodeGPT§§Kashgari§§KoGPT2§§Spark NLP§§Spark NLP Python§§Spark NLP Scala / AraGPT2§§CodeGPT§§Kashgari§§KoGPT2§§Spark NLP§§Spark NLP Python§§Spark NLP Scala
Repository: https://github.com/openai/gpt-2
Reference: Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. Language models are unsupervised multitask learners. https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
GPT-3 / GPT-3
Also known as: Generative Pre-trained Transformer 3 / 
Definition: Third-generation of the GPT language model.
Définition : Troisième génération du modèle de langage GPT.
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Based on: GPT / GPT
Repository: https://github.com/openai/gpt-3
Reference: Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., … Amodei, D. (2020). Language models are few-shot learners. ArXiv:2005.14165 [Cs]. http://arxiv.org/abs/2005.14165
GROBID / GROBID
Definition: GROBID is an Open Source tool for parsing and extracting structured information from technical and scientific documents in raw format like PDF.
Définition : GROBID est un outil libre permettant d'analyser et d'extraire des informations structurées à partir de documents techniques et scientifiques au format tel que le PDF.
Broader concept: Java library / librairie Java
Application field: generic / générique
Tasks performed: annotation of document structure§§normalization / annotation de la structure du document§§normalisation
Implements: bidirectional long-short term memory§§conditional random field / mémoire court et long terme bidirectionnelle§§champ aléatoire conditionnel
Input data: pdf
Programming language: Java
Interface: Web service§§command-line interface§§application programming interface / service Web§§interface en ligne de commande§§interface de programmation d’application
Design country: France / France
Licence: Apache License Version 2.0 / Apache License Version 2.0
Repository: https://github.com/kermitt2/grobid
Ga / ga
Also known as:  / gã
Broader concept: natural language / langage naturel
IETF language tag: gaa
ISO 639-2: gaa
ISO 639-3: gaa
Gagauz / gagaouze
Broader concept: natural language / langage naturel
IETF language tag: gag
ISO 639-3: gag
Galactica / Galactica
Definition: "a large language model that can store, combine and reason about scientific knowledge." (Taylor et al., 2022, p. 1).
Définition : « grand modèle de langage qui peut stocker, combiner et raisonner sur des connaissances scientifiques. » (Taylor et al., 2022, p. 1).
Broader concept: large language model / grand modèle de langue
Application field: astronomy§§biology§§chemistry§§economics§§electrical engineering§§informatics§§logic§§mathematics§§physics / astronomie§§biologie§§chimie§§économie§§électrotechnique§§informatique§§logique§§mathématiques§§physique
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Input languages: English / anglais
Programming language: Python
Design country: United States / États-Unis
Licence: CC BY-NC 4.0 / CC BY-NC 4.0
Repository: https://huggingface.co/models?other=galactica
Galaxy / Galaxy
Definition: Galaxy is an open, web-based platform for accessible, reproducible, and transparent computational biomedical research.
Définition : Galaxy est une plateforme ouverte, basée sur le web, à destination d'une recherche biomédicale computationnelle accessible, reproductible et transparente.
Broader concept: software application / application logicielle
Application field: biology§§medicine / biologie§§médecine
Tasks performed: support operation / opération support
Input languages: graphical user interface / interface utilisateur graphique
Programming language: JavaScript§§Python
Design country:  / États-Unis
Repository: https://github.com/galaxyproject/galaxy
Reference: Gamallo P., Garcia M. A Resource-Based Method for Named Entity Extraction and Classification, (2011), In Progress in Artificial Intelligence. EPIA 2011. Lecture Notes in Computer Science, vol 7026. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24769-9_44
Galician / galicien
Broader concept: natural language / langage naturel
IETF language tag: gl
ISO 639-1: gl
ISO 639-2: glg
ISO 639-3: glg
Ganda / ganda
Also known as: Luganda / luganda
Broader concept: natural language / langage naturel
IETF language tag: lg
ISO 639-1: lg
ISO 639-2: lug
ISO 639-3: lug
Gargantext / Gargantext
Definition: Gargantext is a collaborative web platform for the exploration of sets of unstructured documents. It combines tools from natural language processing, text-mining, complex networks analysis and interactive data visualization to pave the way toward new kinds of interactions with digital corpora.
Définition : Gargantext est un logiciel libre pour l’exploration interactive de grands corpus numériques. Ce service web combine l’exploration de textes avancée, l’analyse de réseau et la visualisation interactive pour fournir de nouvelles formes d’interactions avec les corpus.
Broader concept: software application / application logicielle
Application field: generic / générique
Tasks performed: corpus analysis§§visualization / analyse de corpus§§visualisation
Input data: RIS format§§.txt§§XML§§.csv
Programming language: HTML§§JavaScript§§PHP§§Python
Interface: web user interface / interface utilisateur web
Design country: France / France
Licence: GNU AGPL v3 / GNU AGPL v3
Repository: https://github.com/ISCPIF/python-gargantext
Garhwali / garhwali
Broader concept: natural language / langage naturel
ISO 639-3: gbm
Garifuna / garifuna
Also known as:  / caribe noir
Broader concept: natural language / langage naturel
IETF language tag: cab
ISO 639-3: cab
Gaussian EM clustering / partitionnement EM gaussien
Broader concept: clustering algorithm / algorithme de partitionnement
Implemented by: NLTK / NLTK
gaussian mixture model / modèle de mélange gaussien
Also known as: GMM / 
Broader concept: clustering algorithm / algorithme de partitionnement
Implemented by: scikit-learn / scikit-learn
Gaussian process classifier / classifieur à processus gaussien
Definition: A nonparametric, probabilistic classifier that directly models the posterior probability of class membership.
Définition : Classifieur probabiliste non paramétrique.
Broader concept: classification algorithm / algorithme de classification
Implemented by: scikit-learn / scikit-learn
Reference: Rasmussen, C. E. (2004). Gaussian Processes in Machine Learning. In Advanced Lectures on Machine Learning (pp. 63–71). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-540-28650-9_4
GenSLMs / GenSLMS
Also known as: Genome-scale Language Models / 
Definition: Large language model for genomic data.
Définition : Modèle de langage pour les données génomiques.
Broader concept: large language model / grand modèle de langue
Application field: biology§§medicine / biologie§§médecine
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Programming language: Python
Design country: United States / États-Unis
Licence: MIT License / licence MIT
Based on: GPT / GPT
Repository: https://github.com/ramanathanlab/genslm
Reference: Zvyagin, M., Brace, A., Hippe, K., Deng, Y., Zhang, B., Bohorquez, C. O., Clyde, A., Kale, B., Perez-Rivera, D., Ma, H., Mann, C. M., Irvin, M., Gregory Pauloski, J., Ward, L., Hayot-Sasson, V., Emani, M., Foreman, S., Xie, Z., Lin, D., … Ramanathan, A. (2022). GenSLMs: Genome-scale language models reveal SARS-CoV-2 evolutionary dynamics [Preprint]. Bioinformatics. https://doi.org/10.1101/2022.10.10.511571
generative adversarial network / réseau antagoniste génératif
Also known as: adversarial training / entraînement antagoniste
Definition: "framework for estimating generative models via an adversarial process, in which we simultaneously train two models: a generative model G that captures the data distribution, and a discriminative model D that estimates the probability that a sample came from the training data rather than G." (Goodfellow et al., 2014, p. 1).
Définition : "Cadre pour estimer des modèles génératifs via un processus antagoniste, dans lequel nous entraînons simultanément deux modèles : un modèle génératif G qui capture la distribution des données, et un modèle discriminant D qui estime la probabilité qu'un échantillon provienne des données d'entraînement plutôt que de G." (Goodfellow et al., 2014, p. 1).
Broader concept: Neural networks models / modèles de réseaux de neurones
Implemented by: ALUM / ALUM
Reference: Aggarwal, A., Mittal, M., & Battineni, G. (2021). Generative adversarial network : An overview of theory and applications. International Journal of Information Management Data Insights, 1(1), 100004. https://doi.org/10.1016/j.jjimei.2020.100004§§Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014). Generative adversarial nets. Proceedings of the International Conference on Neural Information Processing Systems (NIPS 2014), 2672‑2680.
Genia tagger / Genia tagger
Definition: Part-of-speech tagging, shallow parsing, and named entity recognition for biomedical text.
Définition : Étiquetage des parties du discours, analyse syntaxique superficielle et reconnaissance des entités nommées pour les textes biomédicaux.
Broader concept: software application / application logicielle
Application field: biology§§medicine / biologie§§médecine
Tasks performed: chunking§§named entity recognition§§parsing§§PoS tagging / chunking§§reconnaissance d'entités nommées§§analyse syntaxique§§étiquetage morpho-syntaxique
Input languages: English / anglais
Programming language: C§§C++
Interface: command-line interface / interface en ligne de commande
Design country: United Kingdom / Royaume-Uni
Licence: free to use license / licence libre d'utilisation
Reference: Yoshimasa Tsuruoka, Yuka Tateishi, Jin-Dong Kim, Tomoko Ohta, John McNaught, Sophia Ananiadou, and Jun'ichi Tsujii Developing a Robust Part-of-Speech Tagger for Biomedical Text, Advances in Informatics, (2005), 10th Panhellenic Conference on Informatics, LNCS 3746, pp. 382-392 https://doi.org/10.1007/11573036_36
Genomic ULMFit / Genomic ULMFit
Definition: "ULMFiT for genomic sequence data" (source: https://github.com/kheyer/Genomic-ULMFiT)
Définition : « ULMFit pour les données de séquences génomiques » (source : https://github.com/kheyer/Genomic-ULMFiT)
Broader concept: large language model / grand modèle de langue
Application field: biology / biologie
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Input languages: English / anglais
Programming language: Python
Based on: ULMFiT / ULMFiT
Repository: https://github.com/kheyer/Genomic-ULMFiT
Gensim / Gensim
Definition: A Python library for topic modelling.
Définition : Bilbliothèque Python pour la modélisation de topiques.
Broader concept: Python library / librairie Python
Application field: generic / générique
Tasks performed: word embedding§§information retrieval§§summarization§§text annotation§§tokenization§§topic detection / plongement lexical§§recherche d'information§§résumé automatique§§annotation textuelle§§tokenisation§§identification de topics
Implements: latent Dirichlet allocation§§latent semantic analysis§§singular value decomposition§§Word2Vec / allocation de Dirichlet latente§§analyse sémantique latente§§décomposition en valeurs singulières§§Word2Vec
Input languages: English / anglais
Programming language: Python
Platforms: Linux§§Windows§§macOS
Interface: command-line interface§§application programming interface / interface en ligne de commande§§interface de programmation d’application
Design country: Czech Republic / République tchèque
Licence: GNU LGPL v2.1 / GNU LGPL v2.1
Repository: https://github.com/RaRe-Technologies/gensim§§https://pypi.org/project/gensim/
Reference: Řehůřek, R., & Sojka, P. (2010). Software framework for topic modelling with large corpora. 45‑50. https://doi.org/10.13140/2.1.2393.1847
Georgian / géorgien
Broader concept: natural language / langage naturel
IETF language tag: ka
ISO 639-1: ka
ISO 639-2: geo§§kat
ISO 639-3: kat
German / allemand
Broader concept: natural language / langage naturel
IETF language tag: de
ISO 639-1: de
ISO 639-2: deu§§ger
ISO 639-3: de
German BERT / German BERT
Definition: A BERT model for German.
Définition : Modèle BERT pour l'allemand.
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Input languages: German / allemand
Based on: BERT / BERT
Base of: FARM / FARM
german-lemmatizer / german-lemmatizer
Definition: "Python package (using a Docker image under the hood) to lemmatize German texts. " (source: https://github.com/jfilter/german-lemmatizer)
Définition : « Paquet Python (utilisant une image Docker) pour lemmatiser des textes en allemand. » (source: https://github.com/jfilter/german-lemmatizer).
Broader concept: Python library / librairie Python
Application field: generic / générique
Tasks performed: lemmatization / lemmatisation
Input languages: German / allemand
Programming language: Python
Platforms: Linux§§Windows§§macOS
Interface: command-line interface / interface en ligne de commande
Design country: Germany / Allemagne
Licence: MIT License / licence MIT
Repository: https://github.com/jfilter/german-lemmatizer
GibbsLDA++ / GibbsLDA++
Definition: GibbsLDA++ is a C/C++ implementation of Latent Dirichlet Allocation (LDA) using Gibbs Sampling technique for parameter estimation and inference. It is very fast and is designed to analyze hidden/latent topic structures of large-scale datasets including large collections of text/Web documents.
Définition : GibbsLDA++ est une implémentation en C/C++ de l’allocation de Dirichlet latente utilisant l’échantillonnage de Gibbs pour l’estimation de paramètres et les inférences. Rapide, l’outil est conçu pour analyser les structures thématiques cachées/latentes de jeux de données importants, incluant de larges collections de documents textuels et du web.
Broader concept: C++ library / librairie C++
Application field: generic / générique
Tasks performed: topic detection / identification de topics
Implements: latent Dirichlet allocation / allocation de Dirichlet latente
Programming language: C§§C++
Platforms: Linux§§non-specified UNIX§§Windows
Interface: command-line interface / interface en ligne de commande
Design country: Japan§§Vietnam / Japon§§Vietnam
Licence: GNU GPL v2 / GNU GPL v2
Repository: http://gibbslda.sourceforge.net/
Gilbertese / gilbertin
Also known as: Kiribatese§§Kiribati§§taetae ni Kiribati / kiribatien
Broader concept: natural language / langage naturel
IETF language tag: gil
ISO 639-2: gil
ISO 639-3: gil
Gilyak / nivkhe
Also known as: Amuric§§Nivkh / guiliak§§nivkh
Broader concept: natural language / langage naturel
IETF language tag: niv
ISO 639-3: niv
GloVe jl / GloVe.jl
Definition: Implementation of the GloVe algorithm in Julia.
Définition : Implémentation de l'algorithme GloVe en Julia.
Broader concept: Julia library / librairie Julia
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Implements: GLoVe / GLoVe
Programming language: Julia
Platforms: Linux§§Windows§§macOS
Interface: command-line interface / interface en ligne de commande
Design country: Canada / Canada
Licence: Apache License Version 2.0 / Apache License Version 2.0
Repository: https://github.com/domluna/Glove.jl§§https://www.juliapackages.com/p/glove