|
--- |
|
tags: |
|
- pytorch_model_hub_mixin |
|
- model_hub_mixin |
|
- gender-classification |
|
- VoxCeleb |
|
license: mit |
|
datasets: |
|
- ProgramComputer/voxceleb |
|
--- |
|
|
|
# Voice gender classifier |
|
- This repo contains the inference code to use pretrained human voice gender classifier. |
|
- You could also try 🤗[Huggingface online demo](https://huggingface.co/spaces/JaesungHuh/voice-gender-classifier). |
|
|
|
## Installation |
|
First, clone the original [github repository](https://github.com/JaesungHuh/voice-gender-classifier) |
|
``` |
|
git clone https://github.com/JaesungHuh/voice-gender-classifier.git |
|
``` |
|
|
|
and install the packages via pip. |
|
|
|
``` |
|
cd voice-gender-classifier |
|
pip install -r requirements.txt |
|
``` |
|
|
|
## Usage |
|
``` |
|
import torch |
|
|
|
from model import ECAPA_gender |
|
|
|
# You could directly download the model from the huggingface model hub |
|
model = ECAPA_gender.from_pretrained("JaesungHuh/voice-gender-classifier") |
|
model.eval() |
|
|
|
# If you are using gpu .... |
|
device = torch.device("cuda" if torch.cuda.is_available() else "cpu") |
|
model.to(device) |
|
|
|
# Load the audio file and use predict function to directly get the output |
|
example_file = "data/00001.wav" |
|
with torch.no_grad(): |
|
output = model.predict(example_file, device=device) |
|
print("Gender : ", output) |
|
``` |
|
|
|
## Pretrained weights |
|
For those who need pretrained weights, please download it in [here](https://drive.google.com/file/d/1ojtaa6VyUhEM49F7uEyvsLSVN3T8bbPI/view?usp=sharing) |
|
|
|
## Training details |
|
State-of-the-art speaker verification model already produces good representation of the speaker's gender. |
|
|
|
I used the pretrained ECAPA-TDNN from [TaoRuijie's](https://github.com/TaoRuijie/ECAPA-TDNN) repository, added one linear layer to make two-class classifier, and finetuned the model with the VoxCeleb2 dev set. |
|
|
|
The model achieved **98.7%** accuracy on the VoxCeleb1 identification test split. |
|
|
|
## Caveat |
|
I would like to note the training dataset I've used for this model (VoxCeleb) may not represent the global human population. Please be careful of unintended biases when using this model. |
|
|
|
## Reference |
|
- [Original github repository](https://github.com/JaesungHuh/voice-gender-classifier) |
|
- I modified the model architecture from [TaoRuijie's](https://github.com/TaoRuijie/ECAPA-TDNN) repository. |
|
- For more details about ECAPA-TDNN, check the [paper](https://arxiv.org/abs/2005.07143). |
