Hugging Face model: polyglot-tagger/language-identification
Author: polyglot-tagger
Created: 2026-04-19 22:38:05
Last modified: 2026-06-03 19:57:47
Pipeline: token-classification
Library: transformers
Likes: 0 | Downloads: 24
Tags: transformers, tensorboard, safetensors, xlm-roberta, token-classification, generated_from_trainer, language-identification, codeswitching, multilingual, af, am, ar, as, ba, be, bg, bn, bo, br, bs, ca, ce, ckb, cs, cy, da, de, dv, el, en, eo, es, et, eu, fa, fi, fr, ga, gd, gl, gu, he, hi, hr, hu, hy, id, is, it, ja, jv, ka, kk, km, kn, ko, ku, ky, la, lb, lo, lt, lv, mg, mk, ml, mn, mr, ms, mt, my, ne, nl, no, ny, oc, om, or, pa, pl, ps, pt, rm, ro, ru, sd, si, sk, sl, so, sq, sr, su, sv, sw, ta, te, tg, th, ti, tl, tr, tt, ug, uk, ur, uz, vi, yo, yi, zh, zu, dataset:wikimedia/wikipedia, dataset:HuggingFaceFW/finetranslations, dataset:google/smol, dataset:polyglot-tagger/nlp-noise-snippets, dataset:polyglot-tagger/wikipedia-language-snippets-filtered, dataset:polyglot-tagger/finetranslations-filtered, dataset:polyglot-tagger/tatoeba-filtered, base_model:FacebookAI/xlm-roberta-base, base_model:finetune:FacebookAI/xlm-roberta-base, doi:10.57967/hf/8476, license:mit, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: FacebookAI/xlm-roberta-base
Card metadata:
library_name: transformers
license: mit
base_model: xlm-roberta-base
tags: generated_from_trainer, language-identification, codeswitching
metrics: precision, recall, f1, accuracy
language: multilingual, af, am, ar, as, ba, be, bg, bn, bo, br, bs, ca, ce, ckb, cs, cy, da, de, dv, el, en, eo, es, et, eu, fa, fi, fr, ga, gd, gl, gu, he, hi, hr, hu, hy, id, is, it, ja, jv, ka, kk, km, kn, ko, ku, ky, la, lb, lo, lt, lv, mg, mk, ml, mn, mr, ms, mt, my, ne, nl, no, ny, oc, om, or, pa, pl, ps, pt, rm, ro, ru, sd, si, sk, sl, so, sq, sr, su, sv, sw, ta, te, tg, th, ti, tl, tr, tt, ug, uk, ur, uz, vi, yo, yi, zh, zu
datasets: wikimedia/wikipedia, HuggingFaceFW/finetranslations, google/smol, polyglot-tagger/nlp-noise-snippets, polyglot-tagger/wikipedia-language-snippets-filtered, polyglot-tagger/finetranslations-filtered, polyglot-tagger/tatoeba-filtered
pipeline_tag: token-classification