Articles

A Probabilistic Multimedia Retrieval Model and Its Evaluation

We present a probabilistic model for the retrieval of multimodal documents. The model is based on Bayesian decision theory and combines models for text-based search with models for visual search. The textual m...

Authors: Thijs Westerveld, Arjen P. de Vries, Alex van Ballegooij, Franciska de Jong and Djoerd Hiemstra

Musical Instrument Timbres Classification with Spectral Features

A set of features is evaluated for recognition of musical instruments out of monophonic musical signals. Aiming to achieve a compact representation, the adopted features regard only spectral characteristics of...

Authors: Giulio Agostini, Maurizio Longari and Emanuele Pollastri

Combined Wavelet Video Coding and Error Control for Internet Streaming and Multicast

This paper proposes an integrated approach to Internet video streaming and multicast (e.g., receiver-driven layered multicast (RLM) by McCanne) based on combined wavelet video coding and error control. We desi...

Authors: Tianli Chu and Zixiang Xiong

An Acoustic Human-Machine Front-End for Multimedia Applications

A concept of robust adaptive beamforming integrating stereophonic acoustic echo cancellation is presented which reconciles the need for low-computational complexity and efficient adaptive filtering with versat...

Authors: Wolfgang Herbordt, Herbert Buchner and Walter Kellermann

3D Scan-Based Wavelet Transform and Quality Control for Video Coding

Wavelet coding has been shown to achieve better compression than DCT coding and moreover allows scalability. 2D DWT can be easily extended to 3D and thus applied to video coding. However, 3D subband coding of ...

Authors: Christophe Parisot, Marc Antonini and Michel Barlaud

Comparison of Multiepisode Video Summarization Algorithms

This paper presents a comparison of some methodologies for the automatic construction of video summaries. The work is based on the simulated user principle to evaluate the quality of a video summary in a way t...

Authors: Itheri Yahiaoui, Bernard Merialdo and Benoit Huet

Embedding Color Watermarks in Color Images

Robust watermarking with oblivious detection is essential to practical copyright protection of digital images. Effective exploitation of the characteristics of human visual perception to color stimuli helps to...

Authors: Chun-Hsien Chou and Tung-Lin Wu

Editorial

Authors: Jean-Luc Dugelay and Kenneth Rose

Sinusoidal Analysis-Synthesis of Audio Using Perceptual Criteria

This paper presents a new method for the selection of sinusoidal components for use in compact representations of narrowband audio. The method consists of ranking and selecting the most perceptually relevant s...

Authors: Ted Painter and Andreas Spanias

Unbalanced Multiple-Description Video Coding with Rate-Distortion Optimization

We propose to use multiple-description coding (MDC) to protect video information against packet losses and delay, while also ensuring that it can be decoded using a standard decoder. Video data are encoded int...

Authors: David Comas, Raghavendra Singh, Antonio Ortega and Ferran Marqués

Message from the Editor-in-Chief

Authors: Marc Moonen

Retrieval by Local Motion

Motion feature plays an important role in video retrieval. The current literature mostly addresses motion retrieval only by camera motion and global motion of individual video objects in a video scene. In this...

Authors: Berna Erol and Faouzi Kossentini

The Spirit Will Continue

Authors: K. J. Ray Liu

Noncoherent Multiuser Communications: Multistage Detection and Selective Filtering

We consider noncoherent multiuser detection techniques for a system employing nonlinear modulation of nonorthogonal signals. Our aim is to investigate near-optimum noncoherent multiuser-detection techniques th...

Authors: Rajnish Sinha, Aylin Yener and Roy D. Yates

Adaptive Near-Optimal Multiuser Detection Using a Stochastic and Hysteretic Hopfield Net Receiver

This paper proposes a novel adaptive MUD algorithm for a wide variety (practically any kind) of interference limited systems, for example, code division multiple access (CDMA). The algorithm is based on recent...

Authors: Gábor Jeney, János Levendovszky, László Pap and EC van der Meulen

Blind Adaptive Decorrelating RAKE (DRAKE) Downlink Receiver for Space-Time Block Coded Multipath CDMA

A downlink receiver is proposed for space-time block coded CDMA systems operating in multipath channels. By combining the powerful RAKE receiver concept for a frequency selective channel with space-time decodi...

Authors: Sudharman K. Jayaweera and H. Vincent Poor

Simultaneous Principal-Component Extraction with Application to Adaptive Blind Multiuser Detection

SIPEX-G is a fast-converging, robust, gradient-based PCA algorithm that has been recently proposed by the authors. Its superior performance in synthetic and real data compared with its benchmark counterparts m...

Authors: Deniz Erdogmus, Yadunandana N. Rao, Kenneth E. Hild II and Jose C. Principe

Reduced-Rank Adaptive Filtering Using Krylov Subspace

A unified view of several recently introduced reduced-rank adaptive filters is presented. As all considered methods use Krylov subspace for rank reduction, the approach taken in this work is inspired from Kryl...

Authors: Sergueï Burykh and Karim Abed-Meraim

On the Blind Estimation of Baud-Rate Equalizer Performance

This paper proposes a new method for carrying out joint blind equalization and blind estimation of the bit-error-rate (BER) in the output of baud-rate FIR equalizers. A simple test for assessing decision error...

Authors: João-Batista Destro-Filho

Space-Time Coded MC-CDMA: Blind Channel Estimation, Identifiability, and Receiver Design

Integrating the strengths of multicarrier (MC) modulation and code division multiple access (CDMA), MC-CDMA systems are of great interest for future broadband transmissions. This paper considers the problem of...

Authors: Wei Sun and Hongbin Li

Multiuser Delay-Tracking CDMA Receiver

We propose to integrate delay tracking into a successive interference cancellation (SIC) code division multiple access (CDMA) multiuser detector. Delay-robust SIC was initially proposed for CDMA multiuser dete...

Authors: Wei Zha and Steven D. Blostein

Noise Cancellation with Static Mixtures of a Nonstationary Signal and Stationary Noise

We address the problem of cancelling a stationary noise component from its static mixtures with a nonstationary signal of interest. Two different approaches, both based on second-order statistics, are consider...

Authors: Sharon Gannot and Arie Yeredor

A suboptimal Iterative Method for Maximum-Likelihood Sequence Estimation in a Multipath Context

We present an iterative semiblind suboptimal maximum-likelihood sequence estimation (MLSE) method for single-carrier block transmission over stationary multipath channels. This suboptimal ML detector is based ...

Authors: Olivier Rousseaux, Geert Leus and Marc Moonen

Adaptive Transmitter Precoding for Time Division Duplex CDMA in Fading Multipath Channels: Strategy and Analysis

The recently developed blind adaptive techniques for multiuser detection in code division multiple access (CDMA) systems offer an attractive compromise of performance and complexity. However, the desire to fur...

Authors: Daryl Reynolds, Anders Høst-Madsen and Xiaodong Wang

Blind Reduced-Rank MMSE Detector for DS-CDMA Systems

We first develop a reduced-rank minimum mean squared error (MMSE) detector for direct-sequence (DS) code division multiple access (CDMA) by forcing the linear MMSE detector to lie in a signal subspace of a red...

Authors: Xiaodong Cai, Hongya Ge and Ali N. Akansu

Further Study on MOE-Based Multiuser Detection in Unknown Multipath

The minimum output energy (MOE) receiver has been developed for multiuser detection when multipath distortion is present. Its performance has been shown to be very close to the minimum mean-square-error (MMSE)...

Authors: Zhengyuan Xu

Multiuser Channel Estimation from Higher-Order Statistical Matrix Pencil

This paper presents a new statistical approach to the blind estimation of linear multiple-input multiple-output (MIMO) channels with finite impulse response. A matrix pencil is constructed from a set of fourth...

Authors: Jing Liang and Zhi Ding

Equivalence of Linear MMSE Detection in DS-CDMA and MC-CDMA Systems over Time and Frequency Selective Channels

The goal of this paper is to compare the performance of the linear minimum mean square error (MMSE) detector for a class of code division multiple access (CDMA) systems in time and frequency selective channels...

Authors: Tamer A. Kadous and Akbar M. Sayeed

Editorial

Authors: Zhi Ding, Xiaodong Wang and Marco Lops

Loudspeaker Equalization with Post-Processing

Loudspeaker equalization is an essential technique in audio system design. A well-known equalization scheme is based on the deconvolution of the desired equalized response with the measured impulse response of...

Authors: Wee Ser, Peng Wang and Ming Zhang

Dynamic Bayesian Networks for Audio-Visual Speech Recognition

The use of visual features in audio-visual speech recognition (AVSR) is justified by both the speech generation mechanism, which is essentially bimodal in audio and visual representation, and by the need for f...

Authors: Ara V. Nefian, Luhong Liang, Xiaobo Pi, Xiaoxing Liu and Kevin Murphy

Noise Adaptive Stream Weighting in Audio-Visual Speech Recognition

It has been shown that integration of acoustic and visual information especially in noisy conditions yields improved speech recognition results. This raises the question of how to weight the two modalities in ...

Authors: Martin Heckmann, Frédéric Berthommier and Kristian Kroschel

Statistical Lip-Appearance Models Trained Automatically Using Audio Information

We aim at modeling the appearance of the lower face region to assist visual feature extraction for audio-visual speech processing applications. In this paper, we present a neural network based statistical appe...

Authors: Philippe Daubias and Paul Deléglise

On the Relationship between Face Movements, Tongue Movements, and Speech Acoustics

This study examines relationships between external face movements, tongue movements, and speech acoustics for consonant-vowel (CV) syllables and sentences spoken by two male and two female talkers with differe...

Authors: Jintao Jiang, Abeer Alwan, Patricia A. Keating, Edward T. Auer Jr. and Lynne E. Bernstein

Editorial

Authors: Chalapathy Neti, Gerasimos Potamianos, Juergen Luettin and Eric Vatikiotis-Bateson

A Support Vector Machine-Based Dynamic Network for Visual Speech Recognition Applications

Visual speech recognition is an emerging research field. In this paper, we examine the suitability of support vector machines for visual speech recognition. Each word is modeled as a temporal sequence of visem...

Authors: Mihaela Gordan, Constantine Kotropoulos and Ioannis Pitas

Separation of Audio-Visual Speech Sources: A New Approach Exploiting the Audio-Visual Coherence of Speech Stimuli

We present a new approach to the source separation problem in the case of multiple speech signals. The method is based on the use of automatic lipreading, the objective is to extract an acoustic speech signal ...

Authors: David Sodoyer, Jean-Luc Schwartz, Laurent Girin, Jacob Klinkisch and Christian Jutten

Automatic Speechreading with Applications to Human-Computer Interfaces

There has been growing interest in introducing speech as a new modality into the human-computer interface (HCI). Motivated by the multimodal nature of speech, the visual component is considered to yield inform...

Authors: Xiaozheng Zhang, Charles C. Broun, Russell M. Mersereau and Mark A. Clements

Some Results on the Wavelet Packet Decomposition of Nonstationary Processes

Wavelet/wavelet packet decomposition has become a very useful tool in describing nonstationary processes. Important examples of nonstationary processes encountered in practice are cyclostationary processes or ...

Authors: Sami Touati and Jean-Christophe Pesquet

Moving-Talker, Speaker-Independent Feature Study, and Baseline Results Using the CUAVE Multimodal Speech Corpus

Strides in computer technology and the search for deeper, more powerful techniques in signal processing have brought multimodal research to the forefront in recent years. Audio-visual speech processing has bec...

Authors: Eric K. Patterson, Sabri Gurbuz, Zekeriya Tufekci and John N. Gowdy

Joint Audio-Visual Tracking Using Particle Filters

It is often advantageous to track objects in a scene using multimodal information when such information is available. We use audio as a complementary modality to video data, which, in comparison to vision, can...

Authors: Dmitry N. Zotkin, Ramani Duraiswami and Larry S. Davis

Audio-Visual Speech Recognition Using MPEG-4 Compliant Visual Features

We describe an audio-visual automatic continuous speech recognition system, which significantly improves speech recognition performance over a wide range of acoustic noise levels, as well as under clean audio ...

Authors: Petar S. Aleksic, Jay J. Williams, Zhilin Wu and Aggelos K. Katsaggelos

A Bayesian Approach for Segmentation in Stereo Image Sequences

Stereoscopic image sequence processing has been the focus of considerable attention in recent literature for videoconference applications. A novel Bayesian scheme is proposed in this paper, for the segmentatio...

Authors: George A. Triantafylllidis, Dimitrios Tzovaras and Michael G. Strintzis

Image-Based Multiresolution Implicit Object Modeling

We discuss two image-based 3D modeling methods based on a multiresolution evolution of a volumetric function′s level set. In the former method, the role of the level set implosion is to fuse ("sew" and "stitch...

Authors: Augusto Sarti and Stefano Tubaro

Sliding Adjustment for 3D Video Representation

This paper deals with video coding of static scenes viewed by a moving camera. We propose an automatic way to encode such video sequences using several 3D models. Contrary to prior art in model-based coding wh...

Authors: Franck Galpin and Luce Morin

Mesh Simplification Using the Edge Attributes

This paper presents a novel technique for simplifying a triangulated surface at different levels of resolution. While most existing algorithms, based on iterative vertex decimation, employ the distance for err...

Authors: Il Dong Yun, Kyowoong Choo and Sang Uk Lee

Fingerprint Image Enhancement Based on Second Directional Derivative of the Digital Image

This paper presents a novel approach of fingerprint image enhancement that relies on detecting the fingerprint ridges as image regions where the second directional derivative of the digital image is positive. ...

Authors: Marius Tico, Vesa Onnia and Pauli Kuosmanen

Efficient Measurement of Shape Dissimilarity between 3D Models Using Z-Buffer and Surface Roving Method

Estimation of the shape dissimilarity between 3D models is a very important problem in both computer vision and graphics for 3D surface reconstruction, modeling, matching, and compression. In this paper, we pr...

Authors: In Kyu Park, Kyoung Mu Lee and Sang Uk Lee

Editorial

Authors: Michael G. Strintzis, Ferran Marques and Fabio Lavagetto

A Concept of Approximated Densities for Efficient Nonlinear Estimation

This paper presents the theoretical development of a nonlinear adaptive filter based on a concept of filtering by approximated densities (FAD). The most common procedures for nonlinear estimation apply the ext...

Authors: Virginie F. Ruiz