DOI: 10.5281/zenodo.5545871
title: Machine Learning for Bird Song Learning (ML4BL) dataset

description: <strong>General description</strong> This dataset contains Zebra Finch decisions about perceptual similarity on song units. All the data and files are used for reproducing the results of the paper 'Bird song comparison using deep learning trained from avian perceptual judgments' by the same authors. <strong>Git repo on Zenodo:</strong> https://doi.org/10.5281/zenodo.5545932<br> <strong>Git repo access: </strong>https://github.com/veronicamorfi/ml4bl/tree/v1.0.0 <strong>Directory organisation:</strong><br> ML4BL_ZF<br> |_files<br> |_Final_probes_20200816.csv - all trials and decisions of the birds (aviary 1 cycle 1 data are removed from experiments)<br> |_luscinia_triplets_filtered.csv - triplets to use for training<br> |_mean_std_luscinia_pretraining.pckl - mean and std of luscinia triplets used for trianing<br> |_*_cons_* - % side consistency on triplets (train/test) - train set contains both train and val splits<br> |_*_gt_* - cycle accuracy for triplets of the specific bird (train/test) - train set contains both train and val splits<br> |_*_trials_* - number of decisions made for a triplet (train/test) - train set contains both train and val splits<br> |_*_triplets_* - triplet information (aviary_cycle-acc_birdID, POS, NEG, ANC) (train/test) - train set contains both train and val splits<br> |_*_low*_ - low-margin (ambiguous) triplets (train/val/test)<br> |_*_high_ - high-margin (unambiguous) triplets (train/val/test)<br> |_*_cycle_bird_keys_* - unique aviary_cycle-acc_birdID keys (train/test) - train set contains both train and val splits<br> |_TunedLusciniaV1e.csv - pairwise distance of two recordings computed by Luscinia<br> |_training_setup_1_ordered_acc_single_cons_50_70_trials.pckl - dictionary containing everything needed for training the model (keys: 'train_keys', 'train_triplets', 'val_keys', 'vali_triplets', 'test_triplets', 'test_keys', 'train_mean', 'train_std')<br> |_melspecs - *.pckl - melspectrograms of recordings<br> |_wavs - *wav - recordings<br> |_README.txt <strong>Recordings</strong> 887 syllables extracted from zebra finch song recordings, with a sampling rate of 48kHz and high pass filtered (100Hz), with a 20ms intro/outro fade. <strong>Decisions</strong> Triplets were created from the recordings and the birds made side based decisions about their similarity (see 'Bird song comparison using deep learning trained from avian perceptual judgments' for further information). <strong>Training dictionary Information</strong> Dictionary keys:<br> 'train_keys', 'train_triplets', 'val_keys', 'vali_triplets', 'test_triplets', 'test_keys', 'train_mean', 'train_std' train_triplets/vali_triplets/test_triplets: <br> Aviary_Cycle_birdID, POS, NEG, ANC, Decisions, Cycle_ACC(%), Consistency(%)<br> <br> train_keys/val_keys/test_keys:<br> Aviary_Cycle_birdID train_mean/train_std:<br> shape: (1, mel_bins) <strong>Open Access</strong> This dataset is available under a Creative Commons Attribution 4.0 International (CC BY 4.0) license. <br> <strong>Contact info</strong> Please send any questions about the recordings to:<br> Lies Zandberg: Elisabeth.Zandberg@rhul.ac.uk Please send any feedback or questions about the code and the rest of the data to:<br> Veronica Morfi: g.v.morfi@qmul.ac.uk