datasets-CNRS/ThesoTM huggingface dataset:
Glowe.jl / Glowe.jl
Definition: Julia interface to GloVe (source: https://github.com/zgornel/Glowe.jl).
Définition : Interface Julia pour GloVe (source : https://github.com/zgornel/Glowe.jl).
Broader concept: Julia library / librairie Julia
Tasks performed: word embedding / plongement lexical
Implements: GLoVe / GLoVe
Programming language: Julia
Platforms: Linux§§Windows§§macOS
Interface: command-line interface / interface en ligne de commande
Design country: Belgium / Belgique
Licence: MIT License / licence MIT
Repository: https://github.com/zgornel/Glowe.jl§§https://www.juliapackages.com/p/glowe
Glozz / Glozz
Definition: Annotation platform.
Définition : Plateforme d'annotation.
Broader concept: software application / application logicielle
Application field: generic / générique
Tasks performed: text annotation / annotation textuelle
Input data: .txt
Programming language: Java
Platforms: Linux§§Windows§§macOS
Interface: desktop graphical user interface / interface utilisateur graphique desktop
Design country: France / France
Reference: Aline Étienne, Delphine Battistelli Annotation manuelle des émotions dans des textes écrits avec la plateforme Glozz. : Guide dannotation, (2021), [Rapport de recherche] MoDyCo, Université Paris Nanterre. https://hal.archives-ouvertes.fr/hal-03263194§§Antoine Widlöcher, Yann Mathet. The Glozz platform: a corpus annotation and mining tool, (2012), ln Proceedings of the ACM Symposium on Document Engineering (DocEng12), Sep 2012, Paris, France, pp.171-180. https://hal.archives-ouvertes.fr/hal-01023774
GluonNLP / GluonNLP
Definition: "GluonNLP is a toolkit that helps you solve NLP problems. It provides easy-to-use tools that helps you load the text data, process the text data, and train models." (source: https://github.com/dmlc/gluon-nlp).
Définition : Boîte à outils pour des tâches de traitement automatique du langage et l'entraînement de modèles.
Broader concept: Python library / librairie Python
Application field: generic / générique
Tasks performed: machine translation§§text generation§§word embedding§§sentiment analysis / traduction automatique§§génération de textes§§plongement lexical§§analyse de sentiments
Implements: GLoVe§§transformer§§fastText algorithm / GLoVe§§transformeur§§algorithme fastText
Programming language: Python
Platforms: Linux§§Windows§§macOS
Interface: command-line interface§§application programming interface / interface en ligne de commande§§interface de programmation d’application
Licence: Apache License Version 2.0 / Apache License Version 2.0
Based on: BERT§§ELMo / BERT§§ELMo
Repository: https://github.com/dmlc/gluon-nlp
Gondi / gondi
Broader concept: natural language / langage naturel
IETF language tag: gon
ISO 639-2: gon
ISO 639-3: gon
Gonja / gonja
Also known as: Ngbanya§§Ngbanyito / choroba§§gbanyito
Broader concept: natural language / langage naturel
IETF language tag: gjn
ISO 639-2: nic
ISO 639-3: gjn
Gothic / gotique
Broader concept: German / allemand
IETF language tag: got
ISO 639-2: got
ISO 639-3: got
GottBERT / GottBERT
Definition: A RoBERTa language model for German.
Définition : Modèle de langage basé sur RoBERTa pour l'allemand.
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Input languages: German / allemand
Programming language: Python
Design country: Germany / Allemagne
Based on: RoBERTa / RoBERTa
Repository: https://github.com/pytorch/fairseq/tree/main/examples/gottbert
Reference: Scheible, R., Thomczyk, F., Tippmann, P., Jaravine, V., & Boeker, M. (2020). GottBERT: A pure German Language Model. https://arxiv.org/abs/2012.02110v1
Graphene / Graphene
Definition: "Graphene is an information extraction pipeline which extracts Knowledge Graphs from texts" (source: https://github.com/Lambda-3/Graphene).
Définition : « Graphene est un pipeline pour l'extraction d'informations qui extrait des graphes de connaissances à partir de textes » (source : https://github.com/Lambda-3/Graphene).
Broader concept: Java library / librairie Java
Application field: generic / générique
Tasks performed: relation extraction / extraction de relations
Input languages: English / anglais
Programming language: Java
Platforms: Linux§§Windows§§macOS
Interface: REST service§§command-line interface / service REST§§interface en ligne de commande
Design country: Germany / Allemagne
Licence: GNU GPL v3 / GNU GPL v3
Repository: https://github.com/Lambda-3/Graphene
Reference: Cetto, M., Niklaus, C., Freitas, A., & Handschuh, S. (2018). Graphene: Semantically-linked propositions in open information extraction (arXiv:1807.11276). arXiv. http://arxiv.org/abs/1807.11276
Greek / grec
Broader concept: natural language / langage naturel
IETF language tag: grk
ISO 639-1: el
ISO 639-2: ell§§gre
ISO 639-3: cpg§§ell§§gmy§§grc§§pnt§§tsd§§yej
GreekBERT / GreekBERT
Definition: A BERT language model for Greek.
Définition : Modèle de langage BERT pour le grec.
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Input languages: Greek / grec
Programming language: Python
Design country: Greece / Grèce
Licence: MIT License / licence MIT
Based on: BERT / BERT
Repository: https://github.com/nlpaueb/greek-bert
GreenBioBERT / GreenBioBERT
Definition: "an inexpensive and environmentally friendly version of BioBERTv1.0." (Poerner et al., 2020).
Définition : "une version peu coûteuse et respectueuse de l'environnement de BioBERTv1.0". (Poerner et al., 2020).
Broader concept: large language model / grand modèle de langue
Application field: biology§§medicine / biologie§§médecine
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Input languages: English / anglais
Design country: Germany / Allemagne
Based on: BioBERT / BioBERT
Reference: Poerner, N., Waltinger, U., & Schütze, H. (2020). Inexpensive domain adaptation of pretrained language models : Case studies on biomedical ner and covid-19 qa. ArXiv:2004.03354 [Cs]. http://arxiv.org/abs/2004.03354
group-average agglomerative clustering / partitionnement agglomératif de la moyenne du groupe
Also known as: GAAC / 
Broader concept: clustering algorithm / algorithme de partitionnement
Implemented by: NLTK / NLTK
Guarayu / guarayo
Also known as:  / guarayu
Broader concept: natural language / langage naturel
IETF language tag: gyr
ISO 639-3: gyr
Gujarati / gujarati
Also known as:  / goudjarati
Broader concept: natural language / langage naturel
IETF language tag: gu
ISO 639-1: gu
ISO 639-2: guj
ISO 639-3: guj
Gun / gun-gbe
Also known as: gungbe / goun-gbe§§gungbe
Broader concept: natural language / langage naturel
IETF language tag: guw
ISO 639-3: guw
Haitian Creole / créole haïtien
Broader concept: natural language / langage naturel
IETF language tag: ht
ISO 639-1: ht
ISO 639-2: hat
ISO 639-3: hat
Haka Chin / haka chin
Also known as: Laiholh / 
Broader concept: natural language / langage naturel
ISO 639-3: cnh
Hani / hani
Broader concept: natural language / langage naturel
IETF language tag: hni
ISO 639-3: hni
HateBERT / HateBERT
Definition: "a re-trained BERT model for abusive language detection in English." (Caselli et al., 2021).
Définition : « modèle BERT pré-entraîné pour la détection de langage abusif en anglais. » (Caselli et al., 2021).
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Input languages: English / anglais
Design country: Germany§§Italy§§Netherlands / Allemagne§§Italie§§Pays-Bas
Licence: CC BY 4.0 / CC BY 4.0
Based on: BERT / BERT
Repository: https://osf.io/tbd58/?view_only=cb79b3228d4248ddb875eb1803525ad8
Reference: Caselli, T., Basile, V., Mitrović, J., & Granitzer, M. (2021). HateBERT : Retraining BERT for abusive language detection in English. arXiv:2010.12472 [cs]. http://arxiv.org/abs/2010.12472
Hausa / haoussa
Also known as: Halshe Hausa§§Halshen Hausa / hausa§§hawsa
Broader concept: natural language / langage naturel
IETF language tag: ha
ISO 639-1: ha
ISO 639-2: hau
ISO 639-3: hau
Hawaiian / hawaïen
Broader concept: natural language / langage naturel
IETF language tag: haw
ISO 639-2: haw
ISO 639-3: haw
HeBERT / HeBERT
Definition: A BERT-based language model for modern Hebrew.
Définition : Modèle de langage basé sur BERT pour l'hébreu moderne.
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Implements: transformer / transformeur
Input languages: Hebrew / hébreu
Programming language: Python
Licence: MIT License / licence MIT
Based on: BERT / BERT
Base of: Legal-HeBERT / Legal-HeBERT
Repository: https://github.com/avichaychriqui/HeBERT
Reference: Chriqui, A., & Yahav, I. (2021). HeBERT & HebEMO: A Hebrew BERT model and a tool for polarity analysis and emotion recognition. https://doi.org/10.1287/ijds.2022.0016
Heart of Gold / Heart of Gold
Definition: Middleware architecture for the integration of deep and shallow natural language processing components. It provides a uniform and flexible infrastructure for building applications that use Robust Minimal Recursion Semantics (RMRS) and/or general XML standoff annotation produced by natural language processing components.
Définition : Heart of gold est une architecture permettant l'intégration de composants de traitement du langage naturel. Elle fournit une infrastructure uniforme et flexible pour la construction d'applications utilisant la sémantique de récursion minimale robuste (RMRS) et/ou l'annotation standoff générale XML produite par des composants de traitement du langage naturel.
Broader concept: software application / application logicielle
Application field: generic / générique
Tasks performed: annotation§§chunking§§PoS tagging§§tokenization / annotation§§chunking§§étiquetage morpho-syntaxique§§tokenisation
Input languages: English§§German§§Greek§§Italian§§Japanese§§Norwegian§§Spanish / anglais§§allemand§§grec§§italien§§japonais§§norvégien§§espagnol
Input data: .txt
Programming language: Java
Platforms: Linux
Design country: Germany / Allemagne
Licence: GNU LGPL / GNU LGPL
Hebrew / hébreu
Broader concept: natural language / langage naturel
IETF language tag: he
ISO 639-1: he
ISO 639-2: heb
ISO 639-3: heb
Hellinger distance / distance de Hellinger
Broader concept: clustering algorithm / algorithme de partitionnement
Implemented by: tosca / tosca
HerBERT / HerBERT
Definition: A BERT language model for Polish.
Définition : Modèle de langage BERT pour le polonais.
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Input languages: Polish / polonais
Programming language: Python
Design country: Poland / Pologne
Based on: BERT / BERT
Repository: https://github.com/allegro/HerBERT
Reference: Mroczkowski, R., Rybak, P., Wróblewska, A., & Gawlik, I. (2021). HerBERT : Efficiently pretrained transformer-based language model for Polish. arXiv:2105.01735 [cs]. http://arxiv.org/abs/2105.01735
hierarchical topic modeling / modèle de topiques hiérarchique
Also known as: hierarchical topic modelling / modélisation de topique hiérarchique
Broader concept: topic modelling algorithm / algorithme de modélisation de topiques
Implemented by: CorEx Topic / CorEx Topic
Hiligaynon / hiligaïnon
Also known as: Ilonggo / ilonggo
Broader concept: natural language / langage naturel
IETF language tag: hil
ISO 639-2: hil
ISO 639-3: hil
Hill Mari / mari des montagnes
Also known as: Western Mari / mari occidental
Broader concept: natural language / langage naturel
IETF language tag: mrj
ISO 639-3: mrj
Hina / mina
Also known as: Besleri§§Mina / 
Broader concept: natural language / langage naturel
ISO 639-3: hna
Hindi / hindi
Broader concept: natural language / langage naturel
IETF language tag: hi
ISO 639-1: hi
ISO 639-2: hin
ISO 639-3: hin
Hiri Motu / hiri motou
Also known as: Hiri§§Pidgin Motu§§Police Motu / hiri motu§§police motou
Broader concept: natural language / langage naturel
IETF language tag: ho
ISO 639-1: ho
ISO 639-2: hmo
ISO 639-3: hmo
Hmong / hmong
Also known as: Miao§§Mong / 
Broader concept: natural language / langage naturel
IETF language tag: cqd
ISO 639-2: hmn
ISO 639-3: cqd
Hmu / hmu
Broader concept: natural language / langage naturel
ISO 639-3: hea§§hmq§§hms§§neo
Ho / ho
Broader concept: natural language / langage naturel
IETF language tag: hoc
ISO 639-3: hoc
Huastec / huastèque
Also known as: Huasteco§§Wasteko / tének
Broader concept: natural language / langage naturel
IETF language tag: hus
ISO 639-3: hus
HunPos tagger / HunPos tagger
Definition: Hunpos is an open source reimplementation of TnT, the well known part-of-speech tagger.
Définition : Hunpos est une réimplémentation open source de TnT, l'étiqueteur de parties de discours.
Broader concept: software application / application logicielle
Application field: generic / générique
Tasks performed: PoS tagging / étiquetage morpho-syntaxique
Input languages: English§§Hungarian / anglais§§hongrois
Programming language: OCaml
Platforms: Linux§§Windows§§macOS
Interface: command-line interface / interface en ligne de commande
Design country: Hungary / Hongrie
Licence: Modified BSD / BSD modifiée
Reference: Péter Halácsy, András Kornai, Csaba Oravecz HunPos an open source trigram tagger, (2007), Proceedings of the ACL 2007 Demo and Poster Sessions, pages 209-212, Prague, June 2007. https://aclanthology.org/P07-2053.pdf
Hungarian / hongrois
Broader concept: natural language / langage naturel
IETF language tag: hu
ISO 639-1: hu
ISO 639-2: hun
ISO 639-3: hun§§ohu
Hyperbase / Hyperbase
Definition: Hypertext software for documentary and statistical processing of textual corpora.
Définition : Logiciel hypertexte pour le traitement documentaire et statistique des corpus textuels.
Broader concept: software application / application logicielle
Application field: generic / générique
Tasks performed: concordance analysis§§corpus analysis§§keyword extraction§§lemmatization§§visualization / analyse de concordance§§analyse de corpus§§extraction de mots-clés§§lemmatisation§§visualisation
Implements: correspondence analysis / analyse factorielle des correspondances
Input languages: English§§French§§German§§Italian§§Latin§§Portuguese§§Spanish / anglais§§français§§allemand§§italien§§latin§§portugais§§espagnol
Output data: .txt
Platforms: Windows
Interface: desktop graphical user interface / interface utilisateur graphique desktop
Design country: France / France
Licence: free to use license / licence libre d'utilisation
Uses software: TreeTagger / TreeTagger
Reference: Etienne Brunet. HYPERBASE Manuel de référence https://hal.univ-lorraine.fr/hal-03078849§§Hadria Khelifin Traitement lexicométrique à travers Hyperbase, (2018), Formation sur le logiciel Hyperbase, AJC Crem, Jun 2018, Metz, France
ILSP NLP / ILSP NLP
Definition: ILSP NLP is a Natural Language Processing service developed by the NLP group of the Institute for Language and Speech Processing.
Définition : ILSP NLP est un service de traitement du langage naturel développé par le groupe NLP de l'Institute for Language and Speech Processing.
Broader concept: software application / application logicielle
Application field: generic / générique
Tasks performed: chunking§§constituency parsing§§dependency parsing§§lemmatization§§named entity recognition§§PoS tagging§§sentence splitting§§tokenization / chunking§§analyse en constituants§§analyse en dépendances§§lemmatisation§§reconnaissance d'entités nommées§§étiquetage morpho-syntaxique§§découpage de phrases§§tokenisation
Input languages: Greek / grec
Input data: .txt
Interface: web user interface / interface utilisateur web
Design country: Greece / Grèce
Licence: free to use license / licence libre d'utilisation
INCEpTION / INCEpTION
Definition: INCEpTIOn is a tool for semantic annotation.
Définition : INCEpTIOn est un outil destiné à l'annotation sémantique.
Broader concept: software application / application logicielle
Application field: generic / générique
Tasks performed: annotation / annotation
Programming language: Java
Interface: desktop graphical user interface / interface utilisateur graphique desktop
Design country:  / Allemagne
Licence: Apache License Version 2.0 / Apache License Version 2.0
Repository: https://inception-project.github.io
Reference: Klie J.-C. INCEpTION: Interactive Machine-assisted Annotation, (2018), Proceedings of the First Biennial Conference on Design of Experimental Search & Information Retrieval Systems (DESIRES), Bertinoro, Italy. https://inception-project.github.io/publications/INCEpTION-COLING2018-Demo.pdf§§Klie J.-C., Bugert M., Boullosa B., Eckart de Castilho R. and Gurevych I. The INCEpTION Platform: Machine-Assisted and Knowledge-Oriented Interactive Annotation, (2018), In Proceedings of System Demonstrations of the 27th International Conference on Computational Linguistics (COLING 2018), Santa Fe, New Mexico, USA. https://aclanthology.org/C18-2.pdf
Ibibio / ibibio
Broader concept: natural language / langage naturel
IETF language tag: ibb
ISO 639-3: ibb
Icelandic / islandais
Broader concept: natural language / langage naturel
IETF language tag: is
ISO 639-1: is
ISO 639-2: ice§§isl
ISO 639-3: isl
ISO 639-5: gmq
Ido / ido
Broader concept: natural language / langage naturel
IETF language tag: io
ISO 639-1: io
ISO 639-2: ido
ISO 639-3: ido
Igbo / igbo
Also known as:  / ibo
Broader concept: natural language / langage naturel
IETF language tag: ig
ISO 639-1: og
ISO 639-2: ibo
ISO 639-3: ibo
Ilocano / ilocano
Also known as: Ilokano / ilokano
Broader concept: natural language / langage naturel
IETF language tag: ilo
ISO 639-2: ilo
ISO 639-3: ilo
IndicBERT / IndicBERT
Definition: Multilingual language models for Indian language based on ALBERT.
Définition : Modèles de langage multilingues pour les langues indiennes basés sur ALBERT.
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Input languages: Assamese§§Bengali§§English§§Gujarati§§Hindi§§Kannada§§Malayalam§§Marathi§§Odia§§Punjabi§§Tamil§§Telugu / assamais§§bengali§§anglais§§gujarati§§hindi§§kannada§§malayalam§§marathi§§odia§§pendjabi§§tamoul§§télougou
Programming language: Python
Design country: India / Inde
Licence: MIT License / licence MIT
Based on: ALBERT / ALBERT
Repository: https://github.com/AI4Bharat/indic-bert
Reference: Kakwani, D., Kunchukuttan, A., Golla, S., N.C., G., Bhattacharyya, A., Khapra, M. M., & Kumar, P. (2020). IndicNLPSuite : Monolingual corpora, evaluation benchmarks and pre-trained multilingual language models for indian languages. Findings of the Association for Computational Linguistics: EMNLP 2020, 4948‑4961. https://doi.org/10.18653/v1/2020.findings-emnlp.445
IndoBERT / IndoBERT
Definition: A BERT language model for Indonesian.
Définition : Modèle de langage BERT pour l"indonésien.
Broader concept: large language model / grand modèle de langue
Application field: generic / générique
Tasks performed: word embedding / plongement lexical
Implements: transformer / transformeur
Input languages: Indonesian / indonésien
Programming language: Python
Design country: Australia / Australie
Based on: BERT / BERT
Repository: https://indolem.github.io/IndoBERT/
Reference: Koto, F., Rahimi, A., Lau, J. H., & Baldwin, T. (2020). IndoLEM and IndoBERT : A benchmark dataset and pre-trained language model for indonesian NLP. arXiv:2011.00677 [cs]. http://arxiv.org/abs/2011.00677
Indonesian / indonésien
Broader concept: natural language / langage naturel
IETF language tag: id
ISO 639-1: id
ISO 639-2: ind
ISO 639-3: ind
InfoMap algorithm / algorithme InfoMap
Broader concept: clustering algorithm / algorithme de partitionnement
Implemented by: bibliometrix / bibliometrix
informatics / informatique
Also known as: computer science / 
Broader concept: knowledge area / domaine de connaissance
Application field of: Galactica§§NetBERT§§sciBERT / Galactica§§NetBERT§§sciBERT
Instructor / Instructor
Definition: A language model for text embeddings.
Définition : Modèle de langage pour la plongement de mots.
Broader concept: large language model / grand modèle de langue
Tasks performed: text embedding / plongement de textes
Input languages: English / anglais
Programming language: Python
Design country: Hong Kong§§United States / Hong Kong§§États-Unis
Licence: Apache License Version 2.0 / Apache License Version 2.0
Base of: Spark NLP§§Spark NLP Python§§Spark NLP Scala / Spark NLP§§Spark NLP Python§§Spark NLP Scala
Repository: https://huggingface.co/hkunlp/instructor-xl
Reference: Su, H., Shi, W., Kasai, J., Wang, Y., Hu, Y., Ostendorf, M., Yih, W., Smith, N. A., Zettlemoyer, L., & Yu, T. (2023). One embedder, any task: Instruction-finetuned text embeddings (arXiv:2212.09741). arXiv. https://doi.org/10.48550/arXiv.2212.09741
Interlingua / interlingua
Broader concept: natural language / langage naturel
IETF language tag: ia
ISO 639-1: ia
ISO 639-2: ina
ISO 639-3: ina
Inuktitut / inuktitut
Also known as: Eastern Canadian Inuktitut / inuktitut de l'Est canadien
Broader concept: natural language / langage naturel
IETF language tag: iu
ISO 639-1: iu
ISO 639-2: iku
ISO 639-3: iku
Iramuteq / Iramuteq
Definition: Iramuteq is a free software based on the R interface and intended for multidimensional analysis of texts and survey.
Définition : Iramuteq est un logiciel libre reposant sur l'interface R et destiné à des analyses multidimensionnelles de textes et de questionnaires.
Broader concept: software application / application logicielle
Application field: generic / générique
Tasks performed: corpus analysis§§lemmatization§§visualization / analyse de corpus§§lemmatisation§§visualisation
Implements: classification algorithm§§correspondence analysis§§Reinert clustering / algorithme de classification§§analyse factorielle des correspondances§§partitionnement de Reinert
Input languages: English§§French§§Portuguese§§Spanish / anglais§§français§§portugais§§espagnol
Input data: .txt
Programming language: R language
Platforms: Linux§§Windows§§macOS
Interface: graphical user interface / interface utilisateur graphique
Design country: France / France
Licence: GNU GPL v2 / GNU GPL v2
Reference: Arnoult A. Réflexion méthodologique sur l'usage des logiciels Modalisa et Iramuteq pour l'étude d'un corpus de presse sur l'anorexie mentale, (2016), npss 11, 285-323 https://doi.org/10.7202/1035939ar
Irish / irlandais
Also known as:  / gaélique irlandais
Broader concept: natural language / langage naturel
IETF language tag: ga
ISO 639-1: ga
ISO 639-2: gle
ISO 639-3: gle
Isoko / isoko
Broader concept: natural language / langage naturel
ISO 639-3: iso
Italian / italien
Broader concept: natural language / langage naturel
IETF language tag: it
ISO 639-1: it
ISO 639-2: ita
ISO 639-3: ita
JTextPro / JTextPro
Definition: Java toolkit for text processing
Définition : Boîte à outils Java pour le traitement automatique de textes.
Broader concept: Java library / librairie Java
Tasks performed: chunking§§PoS tagging§§sentence splitting§§tokenization / chunking§§étiquetage morpho-syntaxique§§découpage de phrases§§tokenisation
Implements: conditional random field§§maximum entropy / champ aléatoire conditionnel§§entropie maximale
Input languages: English / anglais
Interface: command-line interface / interface en ligne de commande
Design country: Japan / Japon
Licence: free / libre