Predicting Software Errors Using Feature Selection and Machine Learning Algorithms: A Comparative Study
Predicting Software Errors Using Feature Selection and Machine Learning Algorithms: A Comparative Study
Negin Ramezani Lakandasht1
1) Master s Degree, Computer Software Engineering, Payam Noor University, North Tehran, Tehran, Iran
IOI Code
:
AAHD-ABKBKH
Publication :
National Conference on Information Technology, Nanotechnology, Artificial Intelligence and Technological Futures Studies(itnaf.ir)
Abstract :
Software defect prediction plays a key role in improving software quality and optimally allocating testing resources. However, the presence of irrelevant and redundant features in software datasets can increase model complexity and reduce prediction accuracy. In this paper, the impact of ten feature selection methods from three filtering, masking, and embedding approaches on the performance of six machine learning classifiers, including logistic regression, random forest, support vector machine, k-nearest neighbor, naive Bayes, and XGBoost, is investigated through a comparative experimental study. The experiments are conducted on four datasets CM1, KC1, KC2, and PC1 from the PROMISE repository.
The results show that reducing the feature space not only does not reduce prediction accuracy, but in many cases improves it. The combination of mutual information and random forest-based feature importance provided the most stable results, achieving an average F1 score of 0.742 when combined with XGBoost, which is an improvement of 9.4% over using all features. Furthermore, the selected feature subsets yielded an average dimensionality reduction of 68%. Statistical validation with the Friedman test and Nemenyi post hoc analysis at a significance level of 0.05 confirms the accuracy of these findings. The findings of this study provide practical guidance for researchers and practitioners who develop machine learning models for software defect prediction.
Keywords : software defect prediction feature selection machine learning static code metrics dimensionality reduction xgboost