Hybrid feature fusion from multiple CNN models with bayesian-optimized machine learning classifiers
10.11591/csit.v6i3.p315-325
Dewi Rismawati
,
Sugiyarto Surono
,
Aris Thobirin
Information technology advancements have created big data, necessitating efficient techniques to retrieve helpful information. With its capacity to recognize and categorize patterns in data, especially the growing amount of picture data, deep learning is becoming a viable option. This research aims to develop a medical image classification model using chest X-Ray with four classes, namely Covid-19, Pneumonia, Tuberculosis, and Normal. The proposed method combines the advantages of deep learning and machine learning. Three pre-trained CNN models, VGG16, DenseNet201, and InceptionV3, extract features from images. The features generated from each model are fused to enhance the relevant information. Furthermore, principal component analysis (PCA) was applied to reduce the dimensionality of the features, and Bayesian optimization was used to optimize the hyperparameters of the machine learning algorithms support vector machine (SVM), decision tree (DT), and k-nearest neighbors (k-NN). The resulting classification model was evaluated based on accuracy, precision, recall, and F1-score. The results showed that FF-SVM, which is the proposed model, achieved an accuracy of 98.79% with precision, recall, and F1-score of 98.85%, 98.82%, and 98.84%, respectively. In conclusion, fusing feature extraction from multiple CNN models improved the classification accuracy of each machine-learning model. It provided reliable and accurate predictions for lung image diagnosis using chest X-Ray.
