Skip to main content
EURASIP Journal on Advances in Signal Processing
Download PDF

A System for the Semantic Multimodal Analysis of News Audio-Visual Content

EURASIP Journal on Advances in Signal Processing volume 2010, Article number: 645052 (2010) Cite this article

Abstract

News-related content is nowadays among the most popular types of content for users in everyday applications. Although the generation and distribution of news content has become commonplace, due to the availability of inexpensive media capturing devices and the development of media sharing services targeting both professional and user-generated news content, the automatic analysis and annotation that is required for supporting intelligent search and delivery of this content remains an open issue. In this paper, a complete architecture for knowledge-assisted multimodal analysis of news-related multimedia content is presented, along with its constituent components. The proposed analysis architecture employs state-of-the-art methods for the analysis of each individual modality (visual, audio, text) separately and proposes a novel fusion technique based on the particular characteristics of news-related content for the combination of the individual modality analysis results. Experimental results on news broadcast video illustrate the usefulness of the proposed techniques in the automatic generation of semantic annotations.

Publisher note

To access the full article, please see PDF.

Author information

Affiliations

  1. Centre for Research and Technology Hellas, Informatics and Telematics Institute, 6th Km Charilaou-Thermi Road, P.O. BOX 60361, 57001, Thermi, Greece

    Vasileios Mezaris, Spyros Gidaros, GeorgiosTh Papadopoulos, Ioannis Kompatsiaris & MichaelG Strintzis

  2. Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, 54006, Thessaloniki, Greece

    GeorgiosTh Papadopoulos & MichaelG Strintzis

  3. Language Technology Lab, DFKI GmbH, Stuhlsatzenhausweg 3, 66123, Saarbrucken, Germany

    Walter Kasper & Jörg Steffen

  4. Department of Computer Science/Human Media Interaction, University of Twente, 7500 AE, Enschede, The Netherlands

    Roeland Ordelman, Marijn Huijbregts & Franciska de Jong

  5. Centre for Language and Speech Technology, Radboud University Nijmegen, 6525 HT, Nijmegen, The Netherlands

    Marijn Huijbregts

Authors
  1. Vasileios Mezaris
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Spyros Gidaros
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. GeorgiosTh Papadopoulos
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Walter Kasper
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jörg Steffen
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Roeland Ordelman
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Marijn Huijbregts
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Franciska de Jong
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Ioannis Kompatsiaris
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. MichaelG Strintzis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vasileios Mezaris.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Mezaris, V., Gidaros, S., Papadopoulos, G. et al. A System for the Semantic Multimodal Analysis of News Audio-Visual Content. EURASIP J. Adv. Signal Process. 2010, 645052 (2010). https://doi.org/10.1155/2010/645052

Download citation

Keywords

  • Automatic Generation
  • Individual Modality
  • Multimedia Content
  • Fusion Technique
  • Semantic Annotation