Neural network-aided audio processing for automated vocal coaching
By: Ethan Craigo
Published: 2019
Language: eng
Number of pages: 44
Subjects: Singing; Instruction and study; Computer-assisted instruction; Programming
Description: Research is conducted assessing the feasibility of using neural networks to detect features of the singing voice both idiomatic and unidiomatic to the Western classical singing tradition. This is done in he context of a hypothetical "automated vocal coach" capable of providing singing voice advice independently of any human agent. Data are presented focusing on four criteria of Western classical singing: phonation, laryngeal registration, resonance management, and vibrato. Literature reviews are also presented on all of these criteria to determine their physiology, acoustical properties, and strategies in vocal pedagogy. Networks are binary and ternary classifiers that apply convolution to mel-scaled spectrograms of the isolated singing voice and make judgments based on resulting features. Training results are promising overall but are severely hampered by the absence of large and contrastive datasets illustrating these criteria. Unsurprisingly, factors of singing most visible on a spectrogram are easiest for networks to distinguish.An automated vocal coach does not appear impossible to build, but its constituent networks require much more data collection to be useful in practice"--Abstract.
Notes: Printed on recto only.

"An undergraduate thesis presented jointly to the School of Engineering and Applied Sciences and the Faculty of Arts and Sciences in partial fulfllment of a Bachelor of Arts degree in Computer Science and Music with honors, Harvard University, Cambridge Massachusetts, March 12, 2019"

Demba Ba and Emily Dolan, advisors.

Bachelor of Arts Harvard College 2019

Includes bibliographical references.