Properly keep track of average available samples, greatly reducing
metallic voices and stuttering at the beginning of speech :)