Thursday, July 16, 2020

MPEG131 Press Release: MPEG-H 3D Audio – WG11 (MPEG) promotes Baseline Profile for 3D Audio to final stage

MPEG131 Press Release: Index

MPEG-H 3D Audio – WG11 (MPEG) promotes Baseline Profile for 3D Audio to the final stage

At its 131st meeting, WG11 (MPEG) announces the completion of the new ISO/IEC 23008-3:2019, Amendment 2, "3D Audio Baseline profile, Corrections and Improvements," which has been promoted to Final Draft Amendment (FDAM) status. This amendment introduces a new profile called Baseline profile addressing industry demands. Tailored for broadcast, streaming, and high-quality immersive music delivery use cases, the 3D Audio Baseline profile supports channel and object signals and is a subset of the existing Low Complexity profile. The 3D Audio Baseline profile can be signaled in a backwards compatible fashion, enabling interoperability with existing devices implementing the 3D Audio Low Complexity profile. In addition to its advanced loudness and Dynamic Range Control (DRC), interactivity and accessibility features, the Baseline profile enables the usage of up to 24 audio objects in Level 3 for high quality immersive music delivery.

At the same time, MPEG initiates New Editions at Committee Draft (CD) status for MPEG-H 3D Audio Reference Software and Conformance which incorporate the 3D Audio Baseline profile functionality.
In addition to finalizing the Amendment, WG11 made available the “MPEG-H 3D Audio Baseline Profile Verification Test Report”. This reports on the results of five subjective listening tests assessing the performance of the 3D Audio Baseline profile. Covering a wide range of bit rates and immersive audio use cases, the tests were conducted in nine different test sites with a total of 341 listeners. 

Analysis of the test data resulted in the following conclusions:
  • Test 1 measured performance for the “Ultra-HD Broadcast” use case, in which highly immersive audio material was coded at 768 kb/s and presented using 22.2 or 7.1+4H channel loudspeaker layouts. The test showed that at the bit rate of 768 kb/s, the 3D Audio Baseline Profile easily achieves “ITU-R High-Quality Emission” quality, as needed in broadcast applications.
  • Test 2 measured performance for the “HD Broadcast” or “A/V Streaming” use case, in which immersive audio material was coded at three bit rates: 512 kb/s, 384 kb/s and 256 kb/s and presented using 7.1+4H or 5.1+2H channel loudspeaker layouts. The test showed that for all bit rates, the 3D Audio Baseline Profile achieved a quality of “Excellent” on the MUSHRA subjective quality scale.
  • Test 3 measured performance for the “High Efficiency Broadcast” use case, in which audio material was coded at three bit rates, with specific bit rates depending on the number of channels in the material. Bitrates ranged from 256 kb/s (5.1+2H) to 48 kb/s (stereo). The test showed that for all bit rates, the 3D Audio Baseline Profile achieved a quality of “Excellent” on the MUSHRA subjective quality scale.
  • Test 4 measured performance for the “Mobile” use case, in which immersive audio material was coded at 384 kb/s, and presented via headphones. The 3D Audio FD binaural renderer was used to render a virtual, immersive audio sound stage for the headphone presentation. The test showed that at 384 kb/s, the 3D Audio Baseline Profile with binaural rendering achieved a quality of “Excellent” on the MUSHRA subjective quality scale.
  • Test 5 measured performance for the "High Quality Immersive Music Delivery" use case in which object based immersive music is delivered to the receiver with up to 24 objects at high per object bit rates. This test used 11.1 (as 7.1+4H) as presentation format, with material coded at a rate of 1536 kb/s. The test showed that at that bit rate, the 3D Audio Baseline Profile easily achieves "ITU-R High-Quality Emission" quality, as needed in high quality music delivery applications.

MPEG131 Press Release: Point Cloud Compression – WG11 (MPEG) promotes a Video-based Point Cloud Compression Technology to the FDIS stage

MPEG131 Press Release: Index

Point Cloud Compression – WG11 (MPEG) promotes a Video-based Point Cloud Compression Technology to the FDIS stage

At its 131st meeting, WG11 (MPEG) promoted its Video-based Point Cloud Compression (V-PCC) standard to Final Draft International Standard (FDIS) stage. V-PCC addresses lossless and lossy coding of 3D point clouds with associated attributes such as colors and reflectance. Point clouds are typically represented by extremely large amounts of data, which is a significant barrier for mass market applications. However, the relative ease to capture and render spatial information as point clouds compared to other volumetric video representations makes point clouds increasingly popular to present immersive volumetric data. With the current V-PCC encoder implementation providing compression in the range of 100:1 to 300:1, a dynamic point cloud of one million points could be encoded at 8 Mbit/s with good perceptual quality. Real-time decoding and rendering of V-PCC bitstreams have also been demonstrated on current mobile hardware.

The V-PCC standard leverages video compression technologies and the video eco-system in general (hardware acceleration, transmission services, and infrastructure) while enabling new kinds of applications. The V-PCC standard contains several profiles that leverage existing AVC and HEVC implementations, which may make them suitable to run on existing and emerging platforms. The standard is also extensible to upcoming video specifications such as Versatile Video Coding (VVC) and Essential Video Coding (EVC).

The V-PCC standard is based on Visual Volumetric Video-based Coding (V3C), which is expected to be re-used by other MPEG-I volumetric codecs under development. MPEG is also developing a standard for the carriage of V-PCC and V3C data (ISO/IEC 23090-10) which has been promoted to DIS status at the 130th MPEG meeting.

By providing high-level immersiveness at currently available bandwidths, the V-PCC standard is expected to enable several types of applications and services such as six Degrees of Freedom (6 DoF) immersive media, virtual reality (VR) / augmented reality (AR), immersive real-time communication and cultural heritage.

MPEG131 Press Release: Call for Proposals on Technologies for MPEG-21 Contracts to Smart Contracts Conversion

MPEG131 Press Release: Index

Call for Proposals on Technologies for MPEG-21 Contracts to Smart Contracts Conversion

In the last few years, WG11 (MPEG) has developed a number of standardized ontologies catering to the needs of the music and media industry with respect to codification of Intellectual Property Rights (IPR) information toward the fair trade of music and media. MPEG IPR ontologies and contract expression languages have been developed under the MPEG-21 Multimedia Framework (ISO/IEC 21000) family of standards. MPEG IPR ontologies and contracts can be used by music and media value chain stakeholders to share and exchange in an interoperable way all metadata and contractual information. However, a challenge has been identified, that is, how MPEG IPR ontologies and contracts can be converted to smart contracts that can be executed on existing blockchain environments and, thus, enriching blockchain environments with inference and reasoning capabilities inherently associated with ontologies? By addressing this challenge in a standard way for several smart contract languages would also ensure that MPEG IPR ontologies and contracts prevail as the interlingua for transferring verified contractual data from one blockchain to another.

At its 131st meeting, MPEG issued a Call for Proposals (CfP) on technologies for MPEG-21 IPR contracts to smart contracts conversion. All parties that believe they have relevant technologies are invited to submit proposals for consideration by MPEG. These parties do not necessarily have to be MPEG members. The review of the submissions is planned in the context of the 132nd MPEG meeting. Please contact Jörn Ostermann (ostermann@tnt.uni-hannover.de)  for details on attending this meeting if you are not an MPEG delegate.

MPEG131 Press Release: WG11 (MPEG) Announces VVC – the Versatile Video Coding Standard

MPEG131 Press Release: Index

WG11 (MPEG) Announces VVC – the Versatile Video Coding Standard

WG11 (MPEG) is pleased to announce the completion of the new Versatile Video Coding (VVC) standard at its 131st meeting. The document has been progressed to its final approval ballot as ISO/IEC 23090-3 and will also be known as H.266 in the ITU-T.

VVC is the latest in a series of very successful standards for video coding that have been jointly developed with ITU-T, and it is the direct successor to the well-known and widely used HEVC (Rec. ITU-T H.265 | ISO/IEC 23008-2) and AVC (Rec. ITU-T H.264 | ISO/IEC 14496-10) standards. VVC provides a major benefit in compression over HEVC. Plans are underway to conduct a verification test with formal subjective testing to confirm that VVC achieves an estimated 50% bit rate reduction versus HEVC for equal subjective video quality. Test results have already demonstrated that VVC typically provides about a 40%-bit rate reduction for 4K/UHD video sequences in tests using objective metrics. Application areas especially targeted for the use of VVC include ultra-high definition 4K and 8K video, video with a high dynamic range and wide colour gamut, and video for immersive media applications such as 360° omnidirectional video. Conventional standard-definition and high-definition video content are also supported with similar gains in compression. In addition to improving coding efficiency, VVC also provides highly flexible syntax supporting such use cases as subpicture bitstream extraction, bitstream merging, temporal sublayering, and layered coding scalability.

The VVC standard includes the specification of six profiles to serve the needs of the industry in a wide variety of applications. These include the “Main 10” profile that supports 8- and 10-bit 4:2:0 video, the “Main 10 4:4:4” profile with 4:4:4 and 4:2:2 format support, corresponding “Multilayer Main 10” and “Multilayer Main 10 4:4:4” profiles with support for layered coding, and the “Main 10 Still Picture” and “Main 10 4:4:4 Still Picture” profiles for still image coding employing the same coding tools as in the corresponding video profiles.MPEG also announces completion of ISO/IEC 23002-7 “Versatile supplemental enhancement information for coded video bitstreams” (VSEI), developed jointly with ITU-T as Rec. ITU-T H.274. The new VSEI standard specifies the syntax and semantics of video usability information (VUI) parameters and supplemental enhancement information (SEI) messages for use with coded video bitstreams. VSEI is especially intended for use with VVC, although it is drafted to be generic and flexible so that it may also be used with other types of coded video bitstreams. Once specified in VSEI, different video coding standards and systems-environment specifications can re-use the same SEI messages without the need for defining special-purpose data customized to the specific usage context.

Wednesday, July 15, 2020

QUALINET White Paper on Definitions of Immersive Media Experience (IMEx)

QUALINET announces its recent White Paper on Definitions of Immersive Media Experience (IMEx).

It is online available here https://arxiv.org/abs/2007.07032 for free.

With the coming of age of virtual/augmented reality and interactive media, numerous definitions, frameworks, and models of immersion have emerged across different fields ranging from computer graphics to literary works. Immersion is oftentimes used interchangeably with presence as both concepts are closely related. However, there are noticeable interdisciplinary differences regarding definitions, scope, and constituents that are required to be addressed so that a coherent understanding of the concepts can be achieved. Such consensus is vital for paving the directionality of the future of immersive media experiences (IMEx) and all related matters.

The aim of this white paper is to provide a survey of definitions of immersion and presence which leads to a definition of immersive media experience (IMEx). The Quality of Experience (QoE) for immersive media is described by establishing a relationship between the concepts of QoE and IMEx followed by application areas of immersive media experience. Influencing factors on immersive media experience are elaborated as well as the assessment of immersive media experience. Finally, standardization activities related to IMEx are highlighted and the white paper is concluded with an outlook related to future developments. 

This White Paper is a contribution by QUALINET, the European Network on Quality of Experience in Multimedia Systems and Services (http://www.qualinet.eu/) to the discussions related to Immersive Media Experience (IMEx). It is motivated by the need for definitions around this term to foster a deeper understanding of ideas and concepts originating from multidisciplinary groups but with a joint interest in multimedia experiences. Thus, this white paper has been created mainly with such multimedia experiences in mind but may be also used beyond.

The QUALINET community aims at extending the notion of network-centric Quality of Service (QoS) in multimedia systems, by relying on the concept of Quality of Experience (QoE). The main scientific objective is the development of methodologies for subjective and objective quality metrics taking into account current and new trends in multimedia communication systems as witnessed by the appearance of new types of content and interactions. QUALINET (2010-2014 as COST Action IC1003) meets once a year collocated with QoMEX (http://qomex.org/) to coordinate its activities around 4 Working Groups (WGs): (i) research, (ii) standardization, (iii) training, and (iv) innovation.

List of Authors and Contributors
Andrew Perkis (andrew.perkis@ntnu.no, editor), Christian Timmerer (christian.timmerer@itec.uni-klu.ac.at, editor), Sabina Baraković, Jasmina Baraković Husić, Søren Bech, Sebastian Bosse, Jean Botev, Kjell Brunnström, Luis Cruz, Katrien De Moor, Andrea de Polo Saibanti, Wouter Durnez, Sebastian Egger-Lampl, Ulrich Engelke, Tiago H. Falk, Jesús Gutiérrez, Asim Hameed, Andrew Hines, Tanja Kojic, Dragan Kukolj, Eirini Liotou, Dragorad Milovanovic, Sebastian Möller, Niall Murray, Babak Naderi, Manuela Pereira, Stuart Perry, Antonio Pinheiro, Andres Pinilla, Alexander Raake, Sarvesh Rajesh Agrawal, Ulrich Reiter, Rafael Rodrigues, Raimund Schatz, Peter Schelkens, Steven Schmidt, Saeed Shafiee Sabet, Ashutosh Singla, Lea Skorin-Kapov, Mirko Suznjevic, Stefan Uhrig, Sara Vlahović, Jan-Niklas Voigt- Antons, Saman Zadtootaghaj.

How to reference this white paper
Perkis, A., Timmerer, C., et al., “QUALINET White Paper
on Definitions of Immersive Media Experience (IMEx)”, European Network on Quality of Experience in Multimedia Systems and Services, 14th QUALINET meeting (online), May 25, 2020.

Alternatively, you may export the citation from arXiv: https://arxiv.org/abs/2007.07032.

Tuesday, July 14, 2020

Happy Birthday .mp3

CC BY-SA 3.0
On July 14, 1995, 25 years ago, the file name extension .mp3 has been decided to be used for ISO/IEC 11172-3:1993 "MPEG Audio Layer 3". *** Happy Birthday .mp3 ***

MP3 is used to store elementary streams conforming to MPEG-1 Part 3: Audio (ISO/IEC 11172-3:1993) and MPEG-2 Part 3: Audio (ISO/IEC 13818-3:1995). MP3 revolutionized the music industry and also a small hack has probably contributed to this development (*), i.e., a time-limited reference encoder has been made available to demonstrate the capabilities of this new standard. The time limitation got hacked and the story as we know it began... 

The MP3 story also reminds me of an interview from 2004 by Leonardo Chiariglione where he stated:
When we approved the standard in 1992 no one thought about piracy. PCs were not powerful enough to decode MP3, and internet connections were few and slow. The scenario that most had in mind was that companies would use MP3 to store music in big, powerful servers and broadcast it.
Nowadays, MP3 players can be as small as pins. The MP3 successor Advanced Audio Coding (AAC) is available/deployed nearly everywhere. Additionally, with MPEG-H 3D Audio a new audio codec is available and MPEG is working towards what is called MPEG-I Immersive Audio Coding, but that's another story..

Wednesday, July 8, 2020

What's new in MPEG?

What's new in MPEG?


What: A webinar about what's new in MPEG? (after the 131st MPEG meeting; press release here)
When: Tuesday, July 21, 2020, 10:00 UTC and 21:00 UTC, to accommodate different time zones (What is UTC?)
How: Please register here for 10:00 UTC and 21:00 UTC. Q&A via sli.do starting from July 21.

Topics and Presenters:
  • Welcome and Introduction: Jörn Ostermann, Acting Convenor of WG11 (MPEG)
  • Versatile Video Coding (VVC): Jens-Rainer Ohm and Gary Sullivan, JVET Chairs
  • MPEG 3D Audio: Schuyler Quackenbusch, MPEG Audio Chair
  • Video-based Point Cloud Compression (V-PCC): Marius, Preda, MPEG 3DG Chair
  • MPEG Immersive Video (MIV): Bart Kroon, MPEG Video BoG Chair
  • Carriage of Versatile Video Coding (VVC) and Essential Video Coding (EVC): Young-Kwon Lim, MPEG Systems Chair
  • MPEG Roadmap: Jörn Ostermann, Acting Convenor of WG11 (MPEG)

What’s new in MPEG? from Christian Timmerer

Video recording (10:00 UTC)

Video recording (21:00 UTC)