semvec/pypi-packages huggingface dataset:
lidirl 0.0.1
LID toolkit to improve performance on spontaneous noisy text with data augmentation.
License: Apache License 2.0
Requires Python: >=3
Keywords: language identification,lid,langid,data processing,preprocessing,NLP,natural language processing,comptuational linguistics

LIDIRL is a simple toolkit for LID targeting noisy spontaneous text as one might find in internet data.It allows for training custom models or using a pretrained solution.