IGRF-RFE: A Hybrid Feature Selection Method for MLP-based Network Intrusion Detection on UNSW-NB15 Dataset. (arXiv:2203.16365v1 [cs.LG])

The effectiveness of machine learning models is significantly affected by the
size of the dataset and the quality of features as redundant and irrelevant
features can radically degrade the performance. This paper proposes IGRF-RFE: a
hybrid feature selection method tasked for multi-class network anomalies using
a Multilayer perceptron (MLP) network. IGRF-RFE can be considered as a feature
reduction technique based on both the filter feature selection method and the
wrapper feature selection method. In our proposed method, we use the filter
feature selection method, which is the combination of Information Gain and
Random Forest Importance, to reduce the feature subset search space. Then, we
apply recursive feature elimination(RFE) as a wrapper feature selection method
to further eliminate redundant features recursively on the reduced feature
subsets. Our experimental results obtained based on the UNSW-NB15 dataset
confirm that our proposed method can improve the accuracy of anomaly detection
while reducing the feature dimension. The results show that the feature
dimension is reduced from 42 to 23 while the multi-classification accuracy of
MLP is improved from 82.25% to 84.24%.