MPEG-7

MPEG-7 is a multimedia content description standard. It was standardized in ISO/IEC 15938 (Multimedia content description interface).[1][2][3][4] This description will be associated with the content itself, to allow fast and efficient searching for material that is of interest to the user. MPEG-7 is formally called Multimedia Content Description Interface. Thus, it is not a standard which deals with the actual encoding of moving pictures and audio, like MPEG-1, MPEG-2 and MPEG-4. It uses XML to store metadata, and can be attached to timecode in order to tag particular events, or synchronise lyrics to a song, for example.

It was designed to standardize:

* a set of Description Schemes ("DS") and Descriptors ("D")
* a language to specify these schemes, called the Description Definition Language ("DDL")
* a scheme for coding the description

The combination of MPEG-4 and MPEG-7 has been sometimes referred to as MPEG-47.[5]

## Contents

* 1 Introduction
* 2 Parts
* 3 Relation between description and content
* 4 MPEG-7 tools
* 5 MPEG-7 applications
* 6 See also
* 7 Limitations
* 8 Compare
* 9 References
* 10 External links

## Introduction

MPEG-7 is intended to complement the previous MPEG standards, by standardizing multimedia metadata -- information about the content, not the content itself. MPEG-7 can be used independently of the other MPEG standards - the description might even be attached to an analog movie. The representation that is defined within MPEG-4, i.e. the representation of audio-visual data in terms of objects, is however very well suited to what will be built on the MPEG-7 standard. This representation is basic to the process of categorization. In addition, MPEG-7 descriptions could be used to improve the functionality of previous MPEG standards. With these tools, we can build an MPEG-7 Description and deploy it. According to the requirements document,1 "a Description consists of a Description Scheme (structure) and the set of Descriptor Values (instantiations) that describe the Data." A Descriptor Value is "an instantiation of a Descriptor for a given data set (or subset thereof)." The Descriptor is the syntactic and semantic definition of the content. Extraction algorithms are inside the scope of the standard because their standardization is not required to allow interoperability.

## Parts

The MPEG-7 (ISO/IEC 15938) consists of different Parts. Each part covers a certain aspect of the whole specification.

MPEG-7 Parts[4][6] Part  | Number  | First public release date (First edition)  | Latest public release date (edition)  | Latest amendment  | Title  | Description

|
|
|
|
|
|

Part 1  | ISO/IEC 15938-1 | 2002  | 2002  | 2006  | Systems  | the architectural framework of MPEG-7, the carriage of MPEG-7 content - TeM (Textual format for MPEG-7) and the binary format for MPEG-7 descriptions (BiM)[7]
Part 2  | ISO/IEC 15938-2 | 2002  | 2002  |  | Description definition language  |
Part 3  | ISO/IEC 15938-3 | 2002  | 2002  | 2010  | Visual  |
Part 4  | ISO/IEC 15938-4 | 2002  | 2002  | 2006  | Audio  |
Part 5  | ISO/IEC 15938-5 | 2003  | 2003  | 2015  | Multimedia description schemes  |
Part 6  | ISO/IEC 15938-6 | 2003  | 2003  | 2011  | Reference software  |
Part 7  | ISO/IEC 15938-7 | 2003  | 2003  | 2011  | Conformance testing  |
Part 8  | ISO/IEC TR 15938-8 | 2002  | 2002  | 2011  | Extraction and use of MPEG-7 descriptions  |
Part 9  | ISO/IEC 15938-9 | 2005  | 2005  | 2012  | Profiles and levels  |
Part 10  | ISO/IEC 15938-10 | 2005  | 2005  |  | Schema definition  |
Part 11  | ISO/IEC TR 15938-11 | 2005  | 2005  | 2012  | MPEG-7 profile schemas  |
Part 12  | ISO/IEC 15938-12 | 2008  | 2012  |  | Query format  |
Part 13  | ISO/IEC 15938-13 | 2015  | 2015  |  | Compact descriptors for visual search  |

## Relation between description and content

Independence between description and content

An MPEG-7 architecture requirement is that description must be separate from the audiovisual content.

On the other hand, there must be a relation between the content and description. Thus the description is multiplexed with the content itself.

On the right side you can see this relation between description and content.

## MPEG-7 tools

Relation between different tools and elaboration process of MPEG-7

MPEG-7 uses the following tools:

* Descriptor (D): It is a representation of a feature defined syntactically and semantically. It could be that a unique object was described by several descriptors.
* Description Schemes (DS): Specify the structure and semantics of the relations between its components, these components can be descriptors (D) or description schemes (DS).
* Description Definition Language (DDL): It is based on XML language used to define the structural relations between descriptors. It allows the creation and modification of description schemes and also the creation of new descriptors (D).
* System tools: These tools deal with binarization, synchronization, transport and storage of descriptors. It also deals with Intellectual Property protection.

On the right side you can see the relation between MPEG-7 tools.

## MPEG-7 applications

There are many applications and application domains which will benefit from the MPEG-7 standard. A few application examples are:

* Digital library: Image/video catalogue, musical dictionary.
* Multimedia directory services: e.g. yellow pages.
* Broadcast media selection: Radio channel, TV channel.
* Multimedia editing: Personalized electronic news service, media authoring.
* Security services: Traffic control, production chains...
* E-business: Searching process of products.
* Cultural services: Art-galleries, museums...
* Educational applications.
* Biomedical applications.
* Intelligent multimedia applications that leverage low-level multimedia semantics via formal representation and automated reasoning.[8]

## See also

* Exif
* ID3
* Metadata standards
* MPEG-4 Part 11 – Scene description and application engine
* Multimedia information retrieval
* Query by humming

## Limitations

The MPEG-7 standard was originally written in XML Schema (XSD), which constitutes semi-structured data. For example, the running time of a movie annotated using MPEG-7 in XML is machine-readable data, so software agents will know that the number expressing the running time is a positive integer, but such data is not machine-interpretable (cannot be understood by agents), because it does not convey semantics (meaning), known as the "Semantic Gap." To address this issue, there were many attempts to map the MPEG-7 XML Schema to the Web Ontology Language (OWL), which is a structured data equivalent of the terms of the MPEG-7 standard (MPEG-7Ontos, COMM, SWIntO, etc.). However, these mappings did not really bridge the "Semantic Gap," because low-level video features alone are inadequate for representing video semantics.[9] In other words, annotating an automatically extracted video feature, such as color distribution, does not provide the meaning of the actual visual content.[10]

## Compare

* Material Exchange Format (MXF), a container format for professional digital video and audio media defined by SMPTE.

## References

* B.S. Manjunath (Editor), Philippe Salembier (Editor), and Thomas Sikora (Editor): Introduction to MPEG-7: Multimedia Content Description Interface. Wiley & Sons, April 2002 - ISBN 0-471-48678-7
* Harald Kosch: Distributed Multimedia Database Technologies Supported by MPEG-7 and MPEG-21. CRC Press, January 2004 - ISBN 0-8493-1854-8
* Giorgos Stamou (Editor) and Stefanos Kollias (Editor): Multimedia Content and the Semantic Web: Standards, Methods and Tools. Wiley & Sons, May 2005 - ISBN 0-470-85753-6
* Hyoung-Gook Kim, Nicolas Moreau, and Thomas Sikora: MPEG-7 Audio and Beyond: Audio Content Indexing and Retrieval. Wiley & Sons, October 2005 - ISBN 0-470-09334-X

1. ↑ ISO. "ISO/IEC 15938-1:2002 - Information technology -- Multimedia content description interface -- Part 1: Systems". https://www.iso.org/standard/34228.html.
2. ↑ MPEG. "About MPEG - Achievements". chiariglione.org. http://mpeg.chiariglione.org/achievements.htm.
3. ↑ MPEG. "Terms of Reference". chiariglione.org. http://mpeg.chiariglione.org/terms_of_reference.htm.
4. ↑ 4.0 4.1 MPEG. "MPEG standards - Full list of standards developed or under development". chiariglione.org. http://mpeg.chiariglione.org/standards.htm.
5. ↑ NetworkDictionary. "Complete Protocol dictionary, glossary and reference - M". http://www.networkdictionary.com/protocols/m.php.
6. ↑ ISO/IEC JTC 1/SC 29 (2009-10-30). "MPEG-7 (Multimedia content description interface)". http://kikaku.itscj.ipsj.or.jp/sc29/29w42911.htm#MPEG-7.
7. ↑ ISO/IEC JTC1/SC29/WG11 (October 2004). "MPEG-7 Overview (version 10)". chiariglione.org. http://mpeg.chiariglione.org/standards/mpeg-7/mpeg-7.htm.
8. ↑ "MPEG-7 Ontology". http://mpeg7.org/.
9. ↑ Sikos, Leslie F.; Powers, David M.W. (2015). "Knowledge-Driven Video Information Retrieval with LOD". Proceedings of the Eighth Workshop on Exploiting Semantic Annotations in Information Retrieval. pp. 35–37. doi:10.1145/2810133.2810141. ISBN 9781450337908. https://unisa.alma.exlibrisgroup.com/view/delivery/61USOUTHAUS_INST/12165439490001831.
10. ↑ Boll, Susanne; Klas, Wolfgang; Sheth, Amit (1998). "Overview on Using Metadata to Manage Multimedia Data". Using Metadata to Integrate and Apply Digital Media. McGraw-Hill. p. 3. ISBN 978-0070577350. https://archive.org/details/multimediadatama0000unse/page/3.

## External links

* MPEG-7 Overview
* MPEG-7/-21 Community Portal

* v
* t
* e

MPEG (Moving Picture Experts Group)

* MPEG-1
* 2
* 3
* 4
* 7
* 21
* A
* B
* C
* D
* E
* G
* V
* M
* U
* H

MPEG-1 Parts|

* Part 1: Systems
* Program stream
* Part 2: Video
* based on H.261
* Part 3: Audio
* Layer I
* Layer II
* Layer III

MPEG-2 Parts|

* Part 1: Systems (H.222.0)
* Transport stream
* Program stream
* Part 2: Video (H.262)
* Part 3: Audio
* Layer I
* Layer II
* Layer III
* MPEG Multichannel
* Part 6: DSM CC
* Part 7: Advanced Audio Coding

MPEG-4 Parts|

* Video
* based on H.263
* Audio
* DMIF
* Part 10: Advanced Video Coding (H.264)
* Scene description
* Part 12: ISO base media file format
* MP4 file format
* Streaming text format
* LASeR
* Part 22: Open Font Format
* Part 33: Internet Video Coding

MPEG-7 Parts|

* Description definition language

MPEG-21 Parts|

* Parts 2, 3 and 9: Digital Item
* Part 5: Rights Expression Language

MPEG-D Parts|

* Part 1: MPEG Surround
* Part 3: Unified Speech and Audio Coding

MPEG-G Parts|

* Part 1: Transport and Storage of Genomic Information
* Part 2: Coding of Genomic Information
* Part 3: APIs
* Part 4: Reference Software
* Part 5: Conformance

MPEG-H Parts|

* Part 1: MPEG media transport
* Part 2: High Efficiency Video Coding
* Part 3: MPEG-H 3D Audio
* Part 12: High Efficiency Image File Format

Other|

MPEG-DASH

* v
* t
* e

Multimedia compression and container formats

Video
compression|

| ISO, IEC, MPEG|

* MJPEG
* Motion JPEG 2000
* MPEG-1
* MPEG-2
* Part 2
* MPEG-4
* Part 2 / ASP
* Part 10 / AVC
* MPEG-H
* Part 2 / HEVC
* MPEG-I
* Part 3 / VVC

|

ITU-T, VCEG|

* H.120
* DCT
* H.261
* H.262
* H.263
* H.264 / AVC
* H.265 / HEVC
* H.266 / VVC
* DV

SMPTE|

* VC-1
* VC-2
* VC-3
* VC-5

TrueMotion|

* TrueMotion S
* DCT
* VP3
* VP6
* VP7
* VP8
* VP9
* AV1

Others|

* Apple Video
* AVS
* Bink
* Cinepak
* Daala
* DVI
* EVC
* FFV1
* Huffyuv
* Indeo
* Lagarith
* Microsoft Video 1
* MSU Lossless
* OMS Video
* Pixlet
* ProRes 422
* ProRes 4444
* QuickTime
* Animation
* Graphics
* RealVideo
* RTVideo
* SheerVideo
* Smacker
* Sorenson Video/Spark
* Theora
* Thor
* WMV
* XEB
* YULS

Audio
compression|

| ISO, IEC, MPEG|

* MPEG-1 Layer II
* Multichannel
* MPEG-1 Layer I
* MPEG-1 Layer III (MP3)
* AAC
* HE-AAC
* AAC-LD
* MPEG Surround
* MPEG-4 ALS
* MPEG-4 SLS
* MPEG-4 DST
* MPEG-4 HVXC
* MPEG-4 CELP
* MPEG-D USAC
* MPEG-H 3D Audio

|

ITU-T|

* G.711
* A-law
* µ-law
* G.718
* G.719
* G.722
* G.722.1
* G.722.2
* G.723
* G.723.1
* G.726
* G.728
* G.729
* G.729.1

IETF|

* Opus
* iLBC
* Speex
* Vorbis

3GPP|

* AMR
* AMR-WB
* AMR-WB+
* EVRC
* EVRC-B
* EVS
* GSM-HR
* GSM-FR
* GSM-EFR

ETSI|

* AC-3
* AC-4
* DTS

Others|

* ACELP
* ALAC
* Asao
* ATRAC
* AVS
* CELT
* Codec 2
* DRA
* FLAC
* iSAC
* Monkey's Audio
* TTA
* True Audio
* MT9
* Musepack
* OptimFROG
* OSQ
* QCELP
* RCELP
* RealAudio
* RTAudio
* SD2
* SHN
* SILK
* Siren
* SMV
* SVOPC
* TwinVQ
* VMR-WB
* VSELP
* WavPack
* WMA
* MQA
* aptX
* aptX HD
* aptX Low Latency
* aptX Adaptive
* LDAC
* LHDC
* LLAC

Image
compression|

| IEC, ISO,
IETF, W3C,
ITU-T, JPEG|

* CCITT Group 4
* DCT
* HEIF
* HEVC
* JPEG
* JPEG XR
* JPEG XT
* TIFF/EP
* Arithmetic
* JBIG
* JBIG2
* JPEG-LS
* JPEG 2000
* LZ
* GIF
* PNG
* TIFF
* TIFF/IT

|

Others|

* APNG
* BPG
* DjVu
* EXR
* FLIF
* ICER
* MNG
* PGF
* QTVR
* WBMP
* WebP

Containers|

| ISO, IEC|

* MPEG-ES
* MPEG-PES
* MPEG-PS
* MPEG-TS
* ISO base media file format
* MPEG-4 Part 14 (MP4)
* Motion JPEG 2000
* MPEG-21 Part 9
* MPEG media transport

|

ITU-T|

* H.222.0
* T.802

IETF|

* RTP
* Ogg

SMPTE|

* GXF
* MXF

Others|

* 3GP and 3G2
* AMV
* ASF
* AIFF
* AVI
* AU
* BPG
* Bink
* Smacker
* BMP
* DivX Media Format
* EVO
* Flash Video
* IFF
* M2TS
* Matroska
* WebM
* QuickTime File Format
* RatDVD
* RealMedia
* RIFF
* WAV
* MOD and TOD
* VOB, IFO and BUP

Collaborations|

* NETVC
* MPEG LA
* HEVC Advance

Methods|

* Discrete cosine transform
* DCT
* MDCT
* Entropy
* Arithmetic
* Huffman
* Modified
* FFT
* LPC
* ACELP
* CELP
* LSP
* WLPC
* Lossless
* Lossy
* LZ
* DEFLATE
* LZW
* PCM
* A-law
* µ-law
* ADPCM
* DPCM
* Transform
* Wavelet
* Daubechies
* DWT
* Transform

Lists|

* Comparison of audio coding formats
* Comparison of video codecs
* List of codecs

See Compression methods for techniques and Compression software for codecs

* v
* t
* e

List of International Electrotechnical Commission standards

IEC standards|

* IEC 60027
* IEC 60034
* IEC 60038
* IEC 60062
* IEC 60063
* IEC 60068
* IEC 60112
* IEC 60228
* IEC 60269
* IEC 60297
* IEC 60309
* IEC 60320
* IEC 60364
* IEC 60446
* IEC 60559
* IEC 60601
* IEC 60870
* IEC 60870-5
* IEC 60870-6
* IEC 60906-1
* IEC 60908
* IEC 60929
* IEC 60958
* AES3
* S/PDIF
* IEC 61030
* IEC 61131
* IEC 61131-3
* IEC 61158
* IEC 61162
* IEC 61334
* IEC 61346
* IEC 61355
* IEC 61360
* IEC 61400
* IEC 61499
* IEC 61508
* IEC 61511
* IEC 61850
* IEC 61851
* IEC 61883
* IEC 61960
* IEC 61968
* IEC 61970
* IEC 62014-4
* IEC 62056
* IEC 62061
* IEC 62196
* IEC 62262
* IEC 62264
* IEC 62304
* IEC 62325
* IEC 62351
* IEC 62365
* IEC 62366
* IEC 62379
* IEC 62386
* IEC 62455
* IEC 62680
* IEC 62682
* IEC 62700

ISO/IEC standards|

* ISO/IEC 646
* ISO/IEC 2022
* ISO/IEC 4909
* ISO/IEC 5218
* ISO/IEC 6429
* ISO/IEC 6523
* ISO/IEC 7810
* ISO/IEC 7811
* ISO/IEC 7812
* ISO/IEC 7813
* ISO/IEC 7816
* ISO/IEC 7942
* ISO/IEC 8613
* ISO/IEC 8632
* ISO/IEC 8652
* ISO/IEC 8859
* ISO/IEC 9126
* ISO/IEC 9293
* ISO/IEC 9592
* ISO/IEC 9593
* ISO/IEC 9899
* ISO/IEC 9945
* ISO/IEC 9995
* ISO/IEC 10021
* ISO/IEC 10116
* ISO/IEC 10165
* ISO/IEC 10179
* ISO/IEC 10646
* ISO/IEC 10967
* ISO/IEC 11172
* ISO/IEC 11179
* ISO/IEC 11404
* ISO/IEC 11544
* ISO/IEC 11801
* ISO/IEC 12207
* ISO/IEC 13250
* ISO/IEC 13346
* ISO/IEC 13522-5
* ISO/IEC 13568
* ISO/IEC 13818
* ISO/IEC 14443
* ISO/IEC 14496
* ISO/IEC 14882
* ISO/IEC 15288
* ISO/IEC 15291
* ISO/IEC 15408
* ISO/IEC 15444
* ISO/IEC 15445
* ISO/IEC 15504
* ISO/IEC 15511
* ISO/IEC 15693
* ISO/IEC 15897
* ISO/IEC 15938
* ISO/IEC 16262
* ISO/IEC 17024
* ISO/IEC 17025
* ISO/IEC 18000
* ISO/IEC 18004
* ISO/IEC 18014
* ISO/IEC 19752
* ISO/IEC 19757
* ISO/IEC 19770
* ISO/IEC 19788
* ISO/IEC 20000
* ISO/IEC 21000
* ISO/IEC 21827
* ISO/IEC 23000
* ISO/IEC 23003
* ISO/IEC 23008
* ISO/IEC 23270
* ISO/IEC 23360
* ISO/IEC 24707
* ISO/IEC 24727
* ISO/IEC 24744
* ISO/IEC 24752
* ISO/IEC 26300
* ISO/IEC 27000
* ISO/IEC 27000-series
* ISO/IEC 27002
* ISO/IEC 27040
* ISO/IEC 29119
* ISO/IEC 33001
* ISO/IEC 38500
* ISO/IEC 42010
* ISO/IEC 80000

Related|

* International Electrotechnical Commission

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/MPEG-7. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=MPEG-7&oldid=4157117"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template