A variance reduction framework for stable feature selection

Software quality modeling is the process of using software metrics from previous iterations of development to locate potentially faulty modules in current under-development code. This has become an important part of the software development process, allowing practitioners to focus development efforts where they are most needed. One difficulty encountered in software quality modeling is the problem of high dimensionality, where the number of available software metrics is too large for a classifier to work well. In this case, many of the metrics may be redundant or irrelevant to defect prediction results, thereby selecting a subset of software metrics that are the best predictors becomes important. This process is called feature (metric) selection. There are three major forms of feature selection: filter-based feature rankers, which uses statistical measures to assign a score to each feature and present the user with a ranked list; filter-based feature subset evaluation, which uses statistical measures on feature subsets to find the best feature subset; and wrapper-based subset selection, which builds classification models using different subsets to find the one which maximizes performance. Software practitioners are interested in which feature selection methods are best at providing the most stable feature subset in the face of changes to the data (here, the addition or removal of instances). In this study we select feature subsets using fifteen feature selection methods and then use our newly proposed Average Pairwise Tanimoto Index (APTI) to evaluate the stability of the feature selection methods. We evaluate the stability of feature selection methods on a pair of subsamples generated by our fixed-overlap partitions algorithm. Four different levels of overlap are considered in this study. 13 software metric datasets from two real-world software projects are used in this study. Results demonstrate that ReliefF (RF) is the most stable feature selection method and wrapper based feature subset selection shows least stability. In addition, as the overlap of partitions increased, the stability of the feature selection strategies increased.

Download Full-text

Stable Feature Selection for EEG-based Emotion Recognition

2018 International Conference on Cyberworlds (CW) ◽

10.1109/cw.2018.00042 ◽

2018 ◽

Cited By ~ 1

Author(s):

Zirui Lan ◽

Olga Sourina ◽

Lipo Wang ◽

Yisi Liu ◽

Reinhold Scherer ◽

...

Keyword(s):

Feature Selection ◽

Emotion Recognition ◽

Selection For ◽

Stable Feature

Download Full-text

Stable feature selection and classification algorithms for multiclass microarray data

Biology Direct ◽

10.1186/1745-6150-7-33 ◽

2012 ◽

Vol 7 (1) ◽

pp. 33 ◽

Cited By ~ 18

Author(s):

Sebastian Student ◽

Krzysztof Fujarewicz

Keyword(s):

Feature Selection ◽

Microarray Data ◽

Classification Algorithms ◽

Stable Feature

Download Full-text