Object-based broadcasting – for European leadership in next generation audio experiences

This deliverable describes the representation, archiving and provision of object-based audio. It builds on D4.1, which describes the requirements, and D4.2, which describes the selected and used formats. This deliverable describes the implementation experience gained during the project, especially for the Audio Definition Model and the metadata formats for non-linear reproduction. This deliverable also serves as a documentation of milestone MS4.3 “Final implementation and documentation of formats for representation, archiving and provision of object-based audio” which has been achieved on 31/01/18. D4.3: Final report on representation, archiving and provision of object-based audio © 2015 2018 ORPHEUS Consortium Parties Page 2 of 29 Document revision history Version Date Description of change List of contributor(s) 0v1 21/12/2017 Initial version Andreas Silzle (FHG), Nikolaus Färber (FHG) 0v11 12/01/2018 MAGIX raw text inserted Tilman Herberger 0v12 19/01/2018 MAGIX text refined Marius Vopel 0v2 23/01/2018 Additions by BBC Matt Firth (BBC), David Marston (BBC), Matt Paradis (BBC) 0v3 25/01/2018 Additions by ECANDY Niels Bogaards (ECANDY) 0v4 29/01/2018 Additions by IRT Michael Meier (IRT) 0v5 30/01/2018 Additions by IRCAM Olivier Warusfel (IRCAM), Thibaut Carpentier (IRCAM), Markus Noisternig (IRCAM) 0v6 08/01/2018 Editorial changes Andreas Silzle (FHG) V1.0 12/02/2018 Final editing Uwe Herzog (EURES) Disclaimer This report contains material which is the copyright of certain ORPHEUS Consortium Parties and may not be reproduced or copied without permission. All ORPHEUS Consortium Parties have agreed to publication of this report, the content of which is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License. Neither the ORPHEUS Consortium Parties nor the European Commission warrant that the information contained in the Deliverable is capable of use, or that use of the information is free from risk, and accept no liability for loss or damage suffered by any person using the information. Copyright notice © 2015 2018 ORPHEUS Consortium Parties 1 http://creativecommons.org/licenses/by-nc-nd/3.0/deed. en_US D4.3: Final report on representation, archiving and provision of object-based audio © 2015 2018 ORPHEUS Consortium Parties Page 3 of 29 Executive Summary This deliverable describes the representation, archiving and provision of object-based audio. It builds on D4.1, which describes the requirements and D4.2, which describes the selected and used formats. This deliverable describes the implementation experience gained during the project. The implementation, usage and translation of the Audio Definition Model (ADM) is described for the DAW Sequoia, the real-time production software IP-Studio, the ADMix tools suite, and the MPEG-H format. The formats for the end-user device AV receiver and the end-user software iPhone app and Browser app are explained. It is explained how the Universal Media Composition Protocol (UMCP) format is used in IP-Studio and how it is related to ADM. Also the mapping of ADM to the Sequoia internal data representation is explained and justified. The use cases found in the ADM expert workshop are listed. The ADM pre-processor, mainly developed to reduce the number of audio objects in a meaningful way, with its reduction mechanism is explained. The issues to translate a general ADM description are described. The solution of defining an ADM Broadcast profile and using ADM template is presented. The metadata for the non-linear reproduction, importance levels, inserted in the DAW Sequoia, their usage on the production and reproduction side in the iPhone app, are described. With mechanism variable length requirements from the end-user to a program can be implemented in an elegant way. The usage of DASH and the WebAudio API for the browser implementation in ORPHEUS is explained. D4.3: Final report on representation, archiving and provision of object-based audio © 2015 2018 ORPHEUS Consortium Parties Page 4 of 29 Table of