NgThVinh/ValorantAgentVoiceLines
Viewer โข Updated โข 12.2k โข 239 โข 3
How to use eibautistat/valorant-agent-voice-classifier with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("audio-classification", model="eibautistat/valorant-agent-voice-classifier") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForAudioClassification
processor = AutoProcessor.from_pretrained("eibautistat/valorant-agent-voice-classifier")
model = AutoModelForAudioClassification.from_pretrained("eibautistat/valorant-agent-voice-classifier", device_map="auto")Identifies which of the 26 VALORANT agents is speaking in a voice-line recording. It is part of a voice-line QA & localization assistant for Riot Games (HKUST ISOM5240 project): https://github.com/EthanIsaac/valorant-voiceline-qa
facebook/wav2vec2-base, selected from 3 candidates on validation accuracyNgThVinh/ValorantAgentVoiceLines (revision c2e0d34), split 80/10/10 per agent, grouped by line| Metric | Value |
|---|---|
| Accuracy | 0.905 |
| Macro-F1 | 0.905 |
| CPU time per clip | 478 ms |
from transformers import pipeline
classifier = pipeline("audio-classification", model="eibautistat/valorant-agent-voice-classifier")
classifier("voice_line.wav", top_k=3)
Trained on studio-quality in-game voice lines; recordings with music, sound effects or other speakers may be classified less accurately. Agents: astra, breach, brimstone, chamber, clove, cypher, deadlock, fade, gekko, harbor, iso, jett, kayo, killjoy, neon, omen, phoenix, raze, reyna, sage, skye, sova, tejo, viper, vyse, yoru.
Base model
facebook/wav2vec2-base