What's new with MPEG: Representation of Sensory Effects (RoSE)

This article covers a brave new topic currently being discussed within the Moving Picture Experts Group (MPEG), formally known as ISO/IEC JTC 1/SC 29/WG 11. It comprises a framework for the Representation of Sensory Effects (RoSE) and its context and objectives are described in [1]. Discussions take place via [3] and is open to everyone.

Context and Objectives

The aim of RoSE is to provide a standardized framework which shall allow for controlling sensory effects in order to increase the overall experience of the user when consuming multimedia content. A sensory effect is an effect to augment feelings by stimulating sensory organs in a particular sense of a multimedia application. Examples of sensory effects include - but are not limited to - audio (sound), visual (video), tactile (light, shading, vibration, wind, temperature, fog, water), and olfactory (scent).

Scope of Standardization

The scope of standardization can be divided into description schemes (or sometimes called tools) and systems aspects.

The former - description schemes/tools - covers three topics, namely:

• Sensory Effect Schema (SES): It defines the description schemes and descriptors to represent Sensory Effects
• Sensory Device Schema (SDS): It defines the description schemes and descriptors to represent characteristics of Sensory Devices.
• User Sensory Preferences (USP): It defines the description schemes and descriptors to represent the user preferences on the (rendering) of the sensory effects.

The later - systems aspects - covers two topics, namely:

• Storage (File Format): It defines an application format which is used to package the audiovisual contents and their associated RoSE metadata.
• Transport (Delivery Format): It defines a schema of message forms by which a part (fragment) of RoSE metadata can be delivered. The specific delivery protocols may be out of the standardization scope.

Timeline

• April 2008: "Final" Requirements and Call for Proposals
• July 2008: Evaluation of proposals and Working Draft (WD)
• October 2008: Committee Draft (CD)
• April 2009: Final Committee Draft (FCD)
• October 2009: Final Draft International Standard (FDIS)

References

[1] Context and Objectives, http://www.chiariglione.org/MPEG/working_documents/explorations/RoSE/RoSE-C&O.zip

[2] Draft Requirements for RoSE, http://www.chiariglione.org/MPEG/working_documents/explorations/RoSE/RoSE-Reqs.zip

[3] RoSE AhG Reflector, http://lists.uni-klu.ac.at/mailman/listinfo/rose