Skip to main content

Discriminative Feature Selection via Multiclass Variable Memory Markov Model

Abstract

We propose a novel feature selection method based on a variable memory Markov (VMM) model. The VMM was originally proposed as a generative model trying to preserve the original source statistics from training data. We extend this technique to simultaneously handle several sources, and further apply a new criterion to prune out nondiscriminative features out of the model. This results in a multiclass discriminative VMM (DVMM), which is highly efficient, scaling linearly with data size. Moreover, we suggest a natural scheme to sort the remaining features based on their discriminative power with respect to the sources at hand. We demonstrate the utility of our method for text and protein classification tasks.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Noam Slonim.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Slonim, N., Bejerano, G., Fine, S. et al. Discriminative Feature Selection via Multiclass Variable Memory Markov Model. EURASIP J. Adv. Signal Process. 2003, 850172 (2003). https://doi.org/10.1155/S111086570321115X

Download citation

Keywords

  • variable memory Markov (VMM) model
  • feature selection
  • multiclass discriminative analysis