Publication: Performance of simultaneous perturbation stochastic approximation for feature selection
No Thumbnail Available
Date
2022-01-01
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
© 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.Feature Selection (FS) is an important process in the field of machine learning where complex and large-size datasets are available. By extracting unnecessary properties from the datasets, FS reduces the size of datasets and evaluation time of algorithms and also improves the performance of classification algorithms. The main purpose of the FS is achieving a minimal feature subset from the initial features of the given problem dataset where the minimal feature subset should show an acceptable performance in representing the original dataset. In this study, to generate subsets we used simultaneous perturbation stochastic approximation (SPSA), migrating birds optimization and simulated annealing algorithms. Subsets generated by the algorithms are evaluated by using correlation-based FS and performance of the algorithms is measured by using decision tree (C4.5) as a classifier. To our knowledge, SPSA algorithm is applied to the FS problem as a filter approach for the first time. We present the computational experiments conducted on the 15 datasets taken from UCI machine learning repository. Our results show that SPSA algorithm outperforms other algorithms in terms of accuracy values. Another point is that, all algorithms reduce the number of features by more than 50%.
Description
Keywords
Bilgi Sistemleri, Haberleşme ve Kontrol Mühendisliği, Kontrol ve Sistem Mühendisliği, Sinyal İşleme, Mühendislik ve Teknoloji, Information Systems, Communication and Control Engineering, Control and System Engineering, Signal Processing, Engineering and Technology, Mühendislik, Bilişim ve Teknoloji (ENG), Mühendislik, OTOMASYON & KONTROL SİSTEMLERİ, TELEKOMÜNİKASYON, MÜHENDİSLİK, ELEKTRİK VE ELEKTRONİK, Engineering, Computing & Technology (ENG), ENGINEERING, AUTOMATION & CONTROL SYSTEMS, TELECOMMUNICATIONS, ENGINEERING, ELECTRICAL & ELECTRONIC, Fizik Bilimleri, Bilgisayar Ağları ve İletişim, Control and Systems Engineering, Physical Sciences, Computer Networks and Communications, Feature selection, Meta-heuristics, SPSA
Citation
Algin R., ALKAYA A. F. , AĞAOĞLU M., \"Performance of Simultaneous Perturbation Stochastic Approximation for Feature Selection\", International Conference on Intelligent and Fuzzy Systems, INFUS 2022, İzmir, Türkiye, 19 - 21 Temmuz 2022, cilt.505 LNNS, ss.348-354