Revert "Use a semaphore to prevent us from having to busy wait on the audio buffer queue"

This reverts commit f3b3d2bd089508d1cf245b3447c50f981c2cd98e.