Consistency Measures for Feature Selection: A Formal Definition, Relative Sensitivity Comparison, and a Fast Algorithm

Shin, Kilho; Fernandes, Danny; Miyazaki, Seiya

doi:10.5591/978-1-57735-516-8/IJCAI11-251

Consistency Measures for Feature Selection: A Formal Definition, Relative Sensitivity Comparison, and a Fast Algorithm

Kilho Shin, Danny Fernandes, Seiya Miyazaki

Download BibTeX Cite

Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence. Pages 1491-1496.

https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-251

Abstract

Consistency-based feature selection is an important category of feature selection research yet is defined only intuitively in the literature. First, we formally define a consistency measure, and then using this definition, evaluate 19 feature selection measures from the literature. While only 5 of these were labeledas consistency measures by their original authors, by our definition, an additional 9 measures should be classified as consistency measures. To compare these 14 consistency measures in terms of sensitivity, we introduce the concept of quasilinear compatibility order, and partially determine the order among the measures. Next, we proposea new fast algorithm for consistency-based feature selection. We ran experiments using eleven large datasets to compare the performance of our algorithm against INTERACT and LCC, the only two instances of consistency-based algorithms with potential real world application. Our algorithm shows vast improvement in time efficiency, while its performance in accuracy is comparable with that of INTERACT and LCC.

Kilho Shin, Danny Fernandes, and Seiya Miyazaki. 2011. Consistency Measures for Feature Selection: A Formal Definition, Relative Sensitivity Comparison, and a Fast Algorithm. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, IJCAI-11. IJCAI, 1491–1496. https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-251

@inproceedings{ijcai2011p251,
  title     = {Consistency Measures for Feature Selection: A Formal Definition, Relative Sensitivity Comparison, and a Fast Algorithm},
  author    = {Shin, Kilho and Fernandes, Danny and Miyazaki, Seiya},
  booktitle = {Proceedings of the Twenty-Second International Joint Conference on
               Artificial Intelligence, {IJCAI-11}},
  publisher = {AAAI Press/International Joint Conferences on Artificial Intelligence},
  editor    = {Toby Walsh},
  pages     = {1491--1496},
  year      = {2011},
  month     = {7},
  doi       = {10.5591/978-1-57735-516-8/IJCAI11-251},
  url       = {https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-251},
}

TY  - CPAPER
TI  - Consistency Measures for Feature Selection: A Formal Definition, Relative Sensitivity Comparison, and a Fast Algorithm
AU  - Shin, Kilho
AU  - Fernandes, Danny
AU  - Miyazaki, Seiya
T2  - Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, IJCAI-11
PB  - AAAI Press/International Joint Conferences on Artificial Intelligence
PY  - 2011
SP  - 1491
EP  - 1496
DO  - 10.5591/978-1-57735-516-8/IJCAI11-251
UR  - https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-251
ER  -