MPEG-H 3D Audio

Audio coding standard

MPEG-H 3D Audio, specified as ISO/IEC 23008-3 (MPEG-H Part 3), is an audio coding standard developed by the ISO/IEC Moving Picture Experts Group (MPEG) to support coding audio as audio channels, audio objects, or higher order ambisonics (HOA). MPEG-H 3D Audio can support up to 64 loudspeaker channels and 128 codec core channels.

Objects may be used alone or in combination with channels or HOA components. The use of audio objects allows for interactivity or personalization of a program by adjusting the gain or position of the objects during rendering in the MPEG-H decoder. Audio is encoded using an improved modified discrete cosine transform (MDCT) algorithm.[1]

Channels, objects, and HOA components may be used to transmit immersive sound as well as mono, stereo, or surround sound. The MPEG-H 3D Audio decoder renders the bitstream to a number of standard speaker configurations as well as to misplaced speakers. Binaural rendering of sound for headphone listening is also supported.

These are the ISO standards relating to MPEG-H 3D Audio:

ISO/IEC 23008-3:2022 \- Part 3: 3D audio

ISO/IEC 23008-6:2021/Amd 1:2024 \- Part 6: 3D audio reference software

ISO/IEC 23008-9:2023 \- Part 9: 3D Audio conformance testing

## History

[edit]

In January 2013, the requirements were released for MPEG-H 3D Audio which was for an increase in the immersion of audio and to allow for a greater number of loudspeakers for audio localization.[2] The allowed audio types would be audio channels, audio objects, and HOA.[2]

On September 10, 2014, Fraunhofer IIS demonstrated a real time MPEG-H 3D audio encoder.[3]

In February 2015, MPEG announced that MPEG-H 3D Audio would be published as an International Standard.[4]

On March 10, 2015, the Advanced Television Systems Committee announced that MPEG-H 3D Audio was one of the three standards proposed for the audio system of ATSC 3.0.[5]

On April 10, 2015, Fraunhofer, Technicolor, and Qualcomm demonstrated a live broadcast signal chain consisting of all the elements needed to implement MPEG-H based audio in broadcast television. The demonstration featured a simulated remote truck at a sports event, a network control center, a local affiliate station, and a consumer living room. The audio was produced and encoded through an MPEG-H audio monitoring and authoring unit, mpeg-h real-time broadcast encoders, and real-time professional and consumer MPEG-H decoders. The audio was decoded in the consumer living room on a Technicolor set-top box.[6][7]

In April 2015, the Advanced Television Systems Committee announced that systems from Dolby Laboratories and the MPEG-H Audio Alliance (Fraunhofer, Technicolor, and Qualcomm) would be tested in the coming months for use as the audio layer for the ATSC 3.0 signal.[8]

In August 2015, the Advanced Television Systems Committee announced that systems from Dolby Laboratories and the MPEG-H Audio Alliance were demonstrated to the ATSC showing how they would work in both professional broadcast facilities and consumer home environments.[9][10]

On April 18, 2016, South Korean broadcast equipment manufacturers Kai Media and DS Broadcast announced the availability of MPEG-H 3D Audio in their latest 4K broadcast encoders.[11]

On May 2, 2016, the Advanced Television Systems Committee has elevated the A/342 audio standard for ATSC 3.0 to the status of a Candidate Standard. The MPEG-H Audio Alliance TV audio system and Dolby AC-4 are part of the A/342 standard.[12]

On June 24, 2016, the South Korean standardization organization "Telecommunications Technology Association" TTA published the standard for "Transmission and Reception of Terrestrial UHD TV Broadcasting Service" for the South Korean terrestrial UHD TV broadcasting service to be launched in February 2017. The TTA standard is based on ATSC 3.0 and specifies MPEG-H 3D Audio as the sole audio codec for the 4K TV system.[13][14][15]

On January 3, 2017, Fraunhofer IIS announced a trademark program to identify interoperable products that include MPEG-H.[16]

On January 8, 2019, Sony announced an immersive music service "360 Reality Audio" that uses MPEG-H.[17][18][19]

## Profiles

[edit]

The Main profile of MPEG-H 3D Audio has five levels.[20]

Levels for the Main profile of MPEG-H 3D Audio[20] Level  | Maximum number of
core channels  | Maximum number of
loudspeaker channels

|
|

1  | 8  | 8
2  | 16  | 16
3  | 32  | 24
4  | 64  | 24
5  | 128  | 64

MPEG announced the availability of the MPEG-H 3D Audio Amendment 3 for late 2016. This amendment defines the Low Complexity Profile which includes technology that increases coding efficiency and also adds features designed for use in the broadcast industry.[21]

## See also

[edit]

* MPEG-H – A group of standards developed by the ISO/IEC MPEG
* Dolby AC-4

## References

[edit]

1. ^ Bleidt, R. L.; Sen, D.; Niedermeier, A.; Czelhan, B.; Füg, S.; et al. (2017). "Development of the MPEG-H TV Audio System for ATSC 3.0" (PDF). IEEE Transactions on Broadcasting. 63 (1): 202–236\. doi:10.1109/TBC.2017.2661258. S2CID 30821673.202-236&rft.date=2017&rft_id=info:doi/10.1109/TBC.2017.2661258&rft_id=https://api.semanticscholar.org/CorpusID:30821673#id-name=S2CID&rft.aulast=Bleidt&rft.aufirst=R.+L.&rft.au=Sen,+D.&rft.au=Niedermeier,+A.&rft.au=Czelhan,+B.&rft.au=Füg,+S.&rft_id=https://www.iis.fraunhofer.de/content/dam/iis/en/doc/ame/Conference-Paper/BleidtR-IEEE-2017-Development-of-MPEG-H-TV-Audio-System-for-ATSC-3-0.pdf&rfr_id=info:sid/en.wikipedia.org:MPEG-H+3D+Audio" class="Z3988">
2. ^ a b "Call for Proposals on 3D Audio". MPEG. Retrieved 2015-03-14.
3. ^ "Fraunhofer IIS Demonstrates Real-Time MPEG-H Audio Encoder System for Broadcast Applications at IBC". Business Wire. 2014-09-10. Retrieved 2015-03-15.
4. ^ "MPEG-H 3D Audio progresses to International Standard". MPEG. Retrieved 2015-03-14.
5. ^ "Advanced Television Systems Committee Begins Review of ATSC 3.0 Audio System Proposals". Advanced Television Systems Committee. 2015-03-10. Archived from the original on 2015-03-13. Retrieved 2015-03-14.
6. ^ "Fraunhofer IIS, Qualcomm and Technicolor to Demonstrate the World's First Live Broadcast of MPEG-H Interactive and Immersive TV Audio". Business Wire. Retrieved 9 October 2015.
7. ^ MPEG-H Audio Brings New Features to TV and Streaming Sound, Electronic Design, July 10, 2015
8. ^ "Evaluation of Proposed ATSC 3.0 Audio Systems Begins". Advanced Television Systems Committee. April 2015. Retrieved 9 October 2015.
9. ^ "Listen Up! Atlanta Hears ATSC 3.0 Audio As Proponents Demonstrate Advantages". Advanced Television Systems Committee. 3 August 2015. Retrieved 9 October 2015.
10. ^ "Demonstrations Show Off Potential of ATSC 3.0 Audio Standard". Sports Video Group. Retrieved 9 October 2015.
11. ^ "First broadcast encoders with MPEG-H Audio launched | Fraunhofer Audio Blog". 2016-04-18. Retrieved 2016-08-02.
12. ^ "More ATSC 3.0 Standards Progress! - ATSC". 3 May 2016. Retrieved 2016-08-02.
13. ^ "Transmission and Reception for Terrestrial UHDTV Broadcasting Service". TTA. 2016-06-24. Retrieved 2016-08-02.
14. ^ "Korea Reveals Its Plans for UHDTV at NAB Show". 4 May 2016. Retrieved 2016-08-02.
15. ^ "World's 1st Terrestrial UHD TV Service With MPEG-H Audio | Fraunhofer Audio Blog". 2016-06-30. Retrieved 2016-08-02.
16. ^ "Fraunhofer Announces MPEG-H Trademark to Identify Interoperable Products". Business Wire. 3 January 2017. Retrieved 11 January 2017.
17. ^ Sony. "Sony Introduces All New "360 Reality Audio" Music Experience That Immerses Listeners in a Three-Dimensional Sound Field Powered by Object-Based Spatial Audio Technology". www.prnewswire.com (Press release). Retrieved 2019-01-26.
18. ^ "Sony Unveils the 'Future of Music' With 360 Reality Audio at CES 2019". Billboard. 11 January 2019. Retrieved 2019-01-26.
19. ^ "I want Sony's 360 Reality Audio to be the future of music". Engadget. Retrieved 2019-01-26.
20. ^ a b "Text of ISO/IEC 23008-3/ DAM, 3D Audio Profiles". MPEG. Retrieved 2015-03-14.
21. ^ "MPEG 115 - Geneva - MPEG-H 3D Audio AMD 3 reaches FDAM status | MPEG". mpeg.chiariglione.org. Retrieved 2016-08-02.

## External links

[edit]

* MPEG website
* MPEG-H Audio Alliance
* Fraunhofer TV Audio System
* Audioexpress.com - Fraunhofer IIS shows immersive sound future with MPEG-H at CES2017
* MPEG-H TV Audio System Trademark Program

* v
* t
* e

Multimedia compression and container formats

Video
compression|

| ISO, IEC,
MPEG|

* DV
* MJPEG
* Motion JPEG 2000
* MPEG-1
* MPEG-2
* Part 2
* MPEG-4
* Part 2 / ASP
* Part 10 / AVC
* Part 33 / IVC
* MPEG-H
* Part 2 / HEVC
* MPEG-I
* Part 3 / VVC
* MPEG-5
* Part 1 / EVC
* Part 2 / LCEVC

|

ITU-T, VCEG|

* H.120
* H.261
* H.262
* H.263
* H.264 / AVC
* H.265 / HEVC
* H.266 / VVC
* H.267 / Enhanced Coding Model

SMPTE|

* VC-1
* VC-2
* VC-3
* VC-5
* VC-6

TrueMotion and AOMedia|

* TrueMotion S
* VP3
* VP6
* VP7
* VP8
* VP9
* AV1

Chinese Standard|

* AVS1 P2/AVS+(GB/T 20090.2/16)
* AVS2 P2(GB/T 33475.2,GY/T 299.1)
* HDR Vivid(GY/T 358)
* AVS3 P2(GY/T 368)

Others|

* Apple Video
* AVS
* Bink
* Cinepak
* Daala
* DVI
* FFV1
* Huffyuv
* Indeo
* Lagarith
* Microsoft Video 1
* MSU Lossless
* OMS Video
* Pixlet
* ProRes
* 422
* 4444
* QuickTime
* Animation
* Graphics
* RealVideo
* RTVideo
* SheerVideo
* Smacker
* Sorenson Video/Spark
* Theora
* Thor
* Ut
* WMV
* XEB
* YULS

Audio
compression|

| ISO, IEC,
MPEG|

* MPEG-1 Layer II
* Multichannel
* MPEG-1 Layer I
* MPEG-1 Layer III (MP3)
* AAC
* HE-AAC
* AAC-LD
* MPEG Surround
* MPEG-4 ALS
* MPEG-4 SLS
* MPEG-4 DST
* MPEG-4 HVXC
* MPEG-4 CELP
* MPEG-D USAC
* MPEG-H 3D Audio

|

ITU-T|

* G.711
* A-law
* µ-law
* G.718
* G.719
* G.722
* G.722.1
* G.722.2
* G.723
* G.723.1
* G.726
* G.728
* G.729
* G.729.1

IETF|

* Opus
* iLBC
* Speex
* Vorbis
* FLAC

3GPP|

* AMR
* AMR-WB
* AMR-WB+
* EVRC
* EVRC-B
* EVS
* GSM-HR
* GSM-FR
* GSM-EFR

ETSI|

* AC-3
* AC-4
* DTS

Bluetooth SIG|

* SBC
* LC3

Chinese Standard|

* AVS1 P10(GB/T 20090.10)
* AVS2 P3(GB/T 33475.3)
* Audio Vivid(GY/T 363)
* DRA(GB/T 22726)
* ExAC(SJ/T 11299.4)

Others|

* ACELP
* ALAC
* Asao
* ATRAC
* CELT
* Codec 2
* iSAC
* Lyra
* MELP
* Monkey's Audio
* MT9
* Musepack
* OptimFROG
* OSQ
* QCELP
* RCELP
* RealAudio
* RTAudio
* SD2
* SHN
* SILK
* Siren
* SMV
* SVOPC
* TTA
* True Audio
* TwinVQ
* VMR-WB
* VSELP
* WavPack
* WMA
* MQA
* aptX
* aptX HD
* aptX Low Latency
* aptX Adaptive
* LDAC
* LHDC
* LLAC

Image
compression|

| IEC, ISO, IETF,
W3C, ITU-T, JPEG|

* CCITT Group 4
* GIF
* HEIC / HEIF
* HEVC
* JBIG
* JBIG2
* JPEG
* JPEG 2000
* JPEG-LS
* JPEG XL
* JPEG XR
* JPEG XS
* JPEG XT
* PNG
* TIFF
* TIFF/EP
* TIFF/IT

|

Others|

* APNG
* AV1
* AVIF
* BPG
* DjVu
* EXR
* FLIF
* ICER
* MNG
* PGF
* QOI
* QTVR
* WBMP
* WebP

Containers|

| ISO, IEC|

* MPEG-ES
* MPEG-PES
* MPEG-PS
* MPEG-TS
* ISO/IEC base media file format
* MPEG-4 Part 14 (MP4)
* Motion JPEG 2000
* MPEG-21 Part 9
* MPEG media transport

|

ITU-T|

* H.222.0
* T.802

IETF|

* RTP
* Ogg
* Matroska

SMPTE|

* GXF
* MXF

Others|

* 3GP and 3G2
* AMV
* ASF
* AIFF
* AVI
* AU
* BPG
* Bink
* Smacker
* BMP
* DivX Media Format
* EVO
* Flash Video
* HEIF
* IFF
* M2TS
* Matroska
* WebM
* QuickTime File Format
* RatDVD
* RealMedia
* RIFF
* WAV
* MOD and TOD
* VOB, IFO and BUP

Collaborations|

* NETVC
* MPEG LA
* Alliance for Open Media

Methods|

* Entropy
* Arithmetic
* Huffman
* Modified
* LPC
* ACELP
* CELP
* LSP
* WLPC
* Lossless
* Lossy
* LZ
* DEFLATE
* LZW
* PCM
* A-law
* µ-law
* ADPCM
* DPCM
* Transforms
* DCT
* FFT
* MDCT
* Wavelet
* Daubechies
* DWT

Lists|

* Comparison of audio coding formats
* Comparison of video codecs
* List of codecs

See Compression methods for techniques and Compression software for codecs

* v
* t
* e

MPEG (Moving Picture Experts Group)

* MPEG-1
* 2
* 3
* 4
* 7
* 21
* A
* B
* C
* D
* E
* G
* V
* M
* U
* H
* I
* 5

MPEG-1 Parts|

* Part 1: Systems
* Program stream
* Part 2: Video
* based on H.261
* Part 3: Audio
* Layer I
* Layer II
* Layer III

MPEG-2 Parts|

* Part 1: Systems (H.222.0)
* Transport stream
* Program stream
* Part 2: Video (H.262)
* Part 3: Audio
* Layer I
* Layer II
* Layer III
* MPEG Multichannel
* Part 6: DSM CC
* Part 7: Advanced Audio Coding

MPEG-4 Parts|

* Part 2: Video
* based on H.263
* Part 3: Audio
* Part 6: DMIF
* Part 10: Advanced Video Coding (H.264)
* Part 11: Scene description
* Part 12: ISO base media file format
* Part 14: MP4 file format
* Part 17: Streaming text format
* Part 20: LASeR
* Part 22: Open Font Format
* Part 33: Internet Video Coding

MPEG-7 Parts|

* Part 2: Description definition language

MPEG-21 Parts|

* Parts 2, 3 and 9: Digital Item
* Part 5: Rights Expression Language

MPEG-D Parts|

* Part 1: MPEG Surround
* Part 3: Unified Speech and Audio Coding

MPEG-G Parts|

* Part 1: Transport and Storage of Genomic Information
* Part 2: Coding of Genomic Information
* Part 3: APIs
* Part 4: Reference Software
* Part 5: Conformance

MPEG-H Parts|

* Part 1: MPEG media transport
* Part 2: High Efficiency Video Coding (H.265)
* Part 3: MPEG-H 3D Audio
* Part 12: High Efficiency Image File Format

MPEG-I Parts|

* Part 3: Versatile Video Coding (H.266)

MPEG-5 Parts|

* Part 1: Essential Video Coding
* Part 2: Low Complexity Enhancement Video Coding

Other|

MPEG-DASH

* v
* t
* e

Broadcast video formats

Television

| Analog|

| 405 lines|

* System A

|

525 lines|

* System M (Color systems: NTSC, NTSC-J, Clear-Vision, PAL-M)
* B-MAC

625 lines|

* System B, C, D, G, H, I, K, L, N (Color systems: PAL, PAL-N, PALplus, SECAM)
* MAC

819 lines|

* System E, F

1125 lines|

* MUSE

1250 lines|

* HD-MAC

Audio|

* BTSC (MTS)
* EIAJ
* NICAM
* SAP
* Sound-in-Syncs
* Zweikanalton (A2/IGR)

Hidden signals|

* Captioning
* CGMS-A
* EPG
* GCR
* PDC
* Teletext
* VBI
* VEIL
* VIT
* VITC
* WSS
* XDS

Historical|

* Pre-1940
* Mechanical television
* 180-line
* 343-line
* 375-line
* 441-line
* 455-line
* 567-line
* Field-sequential color system
* OSKM

Digital|

| Interlaced|

* SDTV
* 480i
* 576i
* HDTV
* 1080i

|

Progressive|

* LDTV
* 1seg
* 240p
* 288p
* EDTV
* 480p
* 576p
* HDTV
* 720p
* 1080p
* UHDTV
* 4K
* 8K

MPEG-2 Video|

* ATSC
* DVB
* DVB 3D-TV
* ISDB
* DTMB
* ABS-S

AVS|

* CMMB

AVS+[note 1]|

* DTMB
* ABS-S

MPEG-4 Visual|

* MobaHo![note 2]

MPEG-4 AVC|

* ATSC A/72
* CMMB
* DMB
* DTMB
* DVB
* SBTVD
* 1seg
* MobaHo![note 2]

AVS2[note 1]|

* ABS-S

MPEG-H HEVC|

* ATSC 3.0
* DVB
* HD DMB
* ISDB-S3
* DTMB

Audio|

* AC-3 (5.1)
* AC-4
* DTS
* DRA
* MPEG-1 Audio Layer II
* MPEG Multichannel
* PCM
* LPCM
* AAC
* HE-AAC
* MPEG-H 3D Audio

Hidden signals|

* AFD
* Broadcast flag
* Captioning
* CPCM
* EPG
* Teletext

1. ^ a b Also used in China's DVB-S/S2 network.
2. ^ a b Defunct.

Technical issues

* 14:9 compromise
* Broadcast-safe
* Digital cinema (DCI)
* Display motion blur
* MPEG transport stream
* Reverse Standards Conversion
* Standards conversion
* Television transmitter
* Test card
* Video on demand
* Video processing
* Widescreen signaling
* Templates (Analogue TV Topics)

*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template