Don't try to mix audio if the buffer is empty