Spark NLP / Spark NLP
Definition: Open source text processing library built on Apache Spark.
Définition : Bibliothèque de traitement automatique du langage open source construite sur Apache Spark.
Broader concept: Java library / librairie Java
Tasks performed: machine translation§§sentence embedding§§word embedding§§chunking§§coreference resolution§§dependency parsing§§keyword extraction§§language identification§§lemmatization§§named entity recognition§§normalization§§PoS tagging§§Question Answering§§sentiment analysis§§stemming§§text categorization§§tokenization§§word segmentation / traduction automatique§§plongement de phrases§§plongement lexical§§chunking§§résolution de coréférence§§analyse en dépendances§§extraction de mots-clés§§identification de la langue§§lemmatisation§§reconnaissance d'entités nommées§§normalisation§§étiquetage morpho-syntaxique§§système de questions réponses§§analyse de sentiments§§racinisation§§catégorisation de textes§§tokenisation§§segmentation de mots
Implements: GLoVe§§transformer§§Word2Vec§§doc2vec / GLoVe§§transformeur§§Word2Vec§§doc2vec
Input languages: Abkhazian§§Afrikaans§§Albanian§§Alemannic§§Alsatian§§Amharic§§Arabic§§Aragonese§§Armenian§§Asturian§§Asuri§§Azerbaijani§§Bantu§§Bashkir§§Basque§§Bavarian§§Belarusian§§Bemba§§Bengali§§Bihari§§Bishnupriya Manipuri§§Bislama§§Bosnian§§Bulgarian§§Burmese§§Catalan§§Cebuano§§Central Bikol§§Chamorro§§Chechen§§Chichewa§§Chinese§§Church Slavonic§§Chuukese§§Chuvash§§Coptic§§Corsican§§Croatian§§Czech§§Danish§§Luo§§Dutch§§Efik§§Enawenê-Nawê§§English§§Erzya§§Esperanto§§Estonian§§Ewe§§Faroese§§Finnish§§Flemish§§Fon§§French§§Ga§§Galician§§Ganda§§Georgian§§German§§Gilbertese§§Gothic§§Greek§§Gujarati§§Gun§§Haitian Creole§§Hausa§§Hebrew§§Hiri Motu§§Hungarian§§Icelandic§§Igbo§§Indonesian§§Interlingua§§Irish§§Isoko§§Italian§§Japanese§§Javanese§§Kabyle§§Kannada§§Kanuri§§Kaonde§§Kazakh§§Khmer§§Kinyarwanda§§Kyrgyz§§Kirundi§§Konkani§§Korean§§Kurdish§§Kwangali§§Kwanyama§§Lahnda§§Lao§§Latin§§Latvian§§Lewotobi§§Ligurian§§Limburgish§§Lingala§§Lithuanian§§Lombard§§Louisiana Creole§§Low German§§Lozi§§Luba-Kasai§§Luba-Katanga§§Lunda§§Luvale§§Luxembourgish§§Macedonian§§Maithili§§Malagasy§§Malay§§Malayalam§§Maldivian§§Maltese§§Manx§§Marathi§§Marshallese§§Mauritian Creole§§Mazanderani§§Minangkabau§§Mingrelian§§Mirandese§§Mizo§§Mongolian§§Montenegrin§§Ndonga§§Neapolitan§§Nepali§§Nigerian Pidgin§§Niuean§§North Frisian§§Northern Sámi§§Northern Sotho§§Norwegian§§Nyaneka§§Occitan§§Odia§§Oromo§§Ossetian§§Palatine German§§Pangasinan§§Papiamento§§Pashto§§Persian§§Pijin§§Pohnpeian§§Polish§§Portuguese§§Punjabi§§Quechuan§§Romanian§§Romansh§§Russian§§Ruund§§Samoan§§Sango§§Sardinian§§Sayula Popoluca§§Scots§§Scottish Gaelic§§Serbian§§Serbo-Croatian§§Seychellois Creole§§Shona§§Sicilian§§Sindhi§§Sinhala§§Slovak§§Slovenian§§Somali§§Sotho§§Spanish§§Sranan Tongo§§Sundanese§§Swahili§§Swampy Cree§§Swazi§§Swedish§§Swiss German§§Tagalog§§Tahitian§§Tai§§Tajik§§Tamil§§Tatar§§Telugu§§Tetela§§Tetum§§Tibetan§§Tigrinya§§Tiv§§Tok Pisin§§Tonga§§Tsonga§§Tswana§§Tumbuka§§Turkish§§Turkmen§§Tuvaluan§§Twi§§Tzotzil§§Ukrainian§§Umbundu§§Upper Sorbian§§Urdu§§Uyghur§§Uzbek§§Venda§§Venetian§§Vietnamese§§Wallisian§§Walloon§§Waray§§Welsh§§West Frisian§§Wolaitta§§Wolof§§Xhosa§§Yakut§§Yapese§§Yiddish§§Yoruba§§Yucatec Maya§§Zande§§Zazaki§§Zeelandic§§Zulu§§Kalaallisut§§Paraguayan Guaraní§§Sabanê§§Thai§§Volapük / abkhaze§§afrikaans§§albanais§§alémanique§§alsacien§§amharique§§arabe§§aragonais§§arménien§§asturien§§asuri§§azéri§§langue bantoue§§bachkir§§basque§§bavarois§§biélorusse§§bemba§§bengali§§bihari§§bishnupriya manipuri§§bichelamar§§bosnien§§bulgare§§birman§§catalan§§cebuano§§bicolano central§§chamorro§§tchétchène§§chewa§§chinois§§slavon d'église§§chuuk§§tchouvache§§copte§§corse§§croate§§tchèque§§danois§§luo§§néerlandais§§efik§§enawenê-nawê§§anglais§§erzya§§espéranto§§estonien§§éwé§§féroïen§§finnois§§flamand§§fon§§français§§ga§§galicien§§ganda§§géorgien§§allemand§§gilbertin§§gotique§§grec§§gujarati§§gun-gbe§§créole haïtien§§haoussa§§hébreu§§hiri motou§§hongrois§§islandais§§igbo§§indonésien§§interlingua§§irlandais§§isoko§§italien§§japonais§§javanais§§kabyle§§kannada§§kanouri§§Chikaonde§§kazakh§§khmer§§kinyarwanda§§kirghize§§kirundi§§konkani§§coréen§§kurde§§Kwangali§§Kuanyama§§Lahnda§§lao§§latin§§letton§§lewotobi§§ligure§§limbourgeois§§lingala§§lithuanien§§lombard§§créole louisianais§§bas allemand§§lozi§§uba-kasaï§§luba-katanga§§lunda§§luvale§§luxembourgeois§§macédonien§§maïthili§§malgache§§malais§§malayalam§§maldivien§§maltais§§manxois§§marathi§§marshallais§§créole mauricien§§mazandarani§§minangkabau§§mingrélien§§mirandais§§mizo§§mongol§§monténégrin§§ndonga§§napolitain§§népalais§§pidgin nigérian§§niuéen§§frison septentrional§§same du Nord§§sotho du Nord§§norvégien§§Nyaneka§§occitan§§odia§§oromo§§ossète§§palatin§§pangasinan§§papiamento§§pachto§§persan§§pijin§§pohnpei§§polonais§§portugais§§pendjabi§§quechua§§roumain§§romanche§§russe§§ruund§§samoan§§sango§§sarde§§popoluca de Sayula§§scots§§gaélique écossais§§serbe§§serbo-croate§§créole seychellois§§shona§§sicilien§§sindhi§§singhalais§§slovaque§§slovène§§somali§§sotho du Sud§§espagnol§§Sranan§§soundanais§§swahili§§swampy cree§§swati§§suédois§§suisse allemand§§tagalog§§tahitien§§taï§§tadjik§§tamoul§§tatar§§télougou§§tetela§§tétoum§§tibétain§§tigrigna§§tiv§§tok pisin§§chitonga§§tsonga§§tswana§§tumbuka§§turc§§turkmène§§tuvaluan§§twi§§tzotzil§§ukrainien§§umbundu§§haut sorabe§§ourdou§§ouïghour§§ouzbek§§venda§§vénitien§§vietnamien§§wallisien§§wallon§§waray-waray§§gallois§§frison occidental§§Wolaitta§§wolof§§xhosa§§iakoute§§yap§§yiddish§§yoruba§§maya yucatèque§§zandé§§zazaki§§zélandais§§zoulou§§groenlandais§§guarani§§sabanê§§thaï§§volapük
Programming language: Java
Interface: command-line interface / interface en ligne de commande
Design country: United States / États-Unis
Licence: Apache License Version 2.0 / Apache License Version 2.0
Based on: ALBERT§§BERT§§CamemBERT§§DeBERTa§§E5§§ELMo§§GPT-2§§Instructor§§LongFormer§§RoBERTa§§universal sentence encoder§§XLNet§§XLM-RoBERTa§§DistilBERT / ALBERT§§BERT§§CamemBERT§§DeBERTa§§E5§§ELMo§§GPT-2§§Instructor§§LongFormer§§RoBERTa§§encodeur universel de phrases§§XLNet§§XLM-RoBERTa§§DistilBERT
Repository: https://github.com/JohnSnowLabs/spark-nlp
Reference: Kocaman, V., & Talby, D. (2021). Spark NLP: Natural language understanding at scale. Software Impacts, 8, 100058. https://doi.org/10.1016/j.simpa.2021.100058