Reliable Audio for Use over the Internet (2006)

This paper investigates the current problems found with audio applications over the MBONE (Multi-cast Backbone Overlay)/Internet, and, based on preliminary studies, describes possible solutions. The authors describe how current audio applications work, and how this structure enables redundancy to be a viable solution to the problem of packet loss. The paper proposes the use of synthetic speech coding algorithms (vocoders) to provide redundancy; the algorithms produce a very low bit-rate stream, which used alone give very mechanical sounding speech. Preliminary experiments show that normal speech repaired with synthetic quality speech is intelligible, even for very high loss rates. The paper goes on to investigate how the redundancy might be included in an audio application for use over the Internet.&#13;\nThe application of this work is multimedia conferencing over the Internet. The work is based on experiences in multi-way multimedia conferencing demonstrations from Project MICE (Multimedia Integrated Conferencing for Europe) (using the popular tool `vat'), Project ReLaTe (Remote Language Teaching over SuperJANET), and preliminary experiments.&#13;\n&#13;\nExperience has shown that the major problem with the MBONE for audio is one of packet loss. Packet loss occurs for a number of reasons: when routers become congested, when packets arrive too late to be played back, or when scheduling difficulties in a multi-tasking operating system occur.&#13;\n&#13;\nExperience has also shown that packet loss is a persistent problem, and it can be expected to get worse. From a user's point of view, packet loss severely disrupts speech intelligibility, even for very low loss rates. Consequently, a solution which renders the speech intelligible at all loss rate levels is required. Intelligible speech in these situations can only be achieved using redundancy; a separate `stream' of speech is transmitted in addition to the primary information.&#13;\n&#13;\nAudio for transmission over the MBONE/Internet has to be split into packets, which are then launched onto the network. At the receiver, the packets may be delivered out of order, or not at all, and packet arrival times are unpredictable. This means that a number of packets must be kept `in hand' during play-out, so that the receiver has chance to re-order packets, and to smooth out unpredictable packet arrival times. Whenever one or more packets are lost, silence is played. This leads to the familiar speech clipping effects currently heard over the Internet. The nature of the Internet (large packets) unfortunately means that packet loss has a serious effect on the intelligibility of speech.&#13;\n&#13;\nThis paper introduces a method of using cheap redundancy within the packets sent from the transmitter. The redundancy is synthetic speech, (Linear Predictive Coding), which, when split into packets only adds a very small amount of overhead to a packet. The redundancy is added later in the train of packets than the primary speech information, which means that the receiver, upon suffering the loss of the primary speech information, has the possibility of substituting something sensible in the output stream of speech, provided that the redundancy can be received.&#13;\n&#13;\nPreliminary experiments have been carried out into the perception of speech repaired with a synthetic substitute. The experiments objectively measured speech intelligibility as well as performing subjective evaluations. The results show that this technique is very successful at repairing speech with large packet sizes and for very high loss rates (results were taken up to 40%).&#13;\n&#13;\nThe paper also identifies how this technique might be used in a multi-cast audio tool for the MBONE, and describes the work that has been done towards the implementation of such a tool to reliably transfer speech across the Internet.