semvec/pypi-packages huggingface dataset:
whisper-lid 0.0.1
Spoken Language IDentification (LID) using multilingual Whisper model
License: Apache License Version 2.0
Keywords: whisper, LID, spoken-language, language-identification, spoken-language-identification


Whisper-LID
===============

This is a spoken language identification system that is based on the Whisper
model. The system uses the Whisper-based algorithm to identify spoken languages
or non-speech event. The Section 2.3 of the paper about Whisper
(https://arxiv.org/abs/2212.04356) states that language tags or non-speech
tags need to be predicted after the `
` special token.
Based on this information, the system estimates a probability distribution
for the next token after the `
` and selects the token
with the highest probability as the final spoken language prediction. Since
the predicted token can be either a language tag or a non-speech tag, the
system combines the features of a spoken language identifier and a voice
activity detector.