Analyzing Preprocessing Impact on Machine Learning Classifiers for Cryotherapy and Immunotherapy Dataset
DOI:
https://doi.org/10.62411/faith.2024-2Keywords:
BiGRU classification, Feature engineering, Small dataset, SMOTE, Tomek linksAbstract
In the clinical treatment of skin diseases and cancer, cryotherapy and immunotherapy offer effective and minimally invasive alternatives. However, the complexity of patient response demands more sophisticated analytical strategies for accurate outcome prediction. This research focuses on analyzing the effect of preprocessing in various machine learning models on the prediction performance of cryotherapy and immunotherapy. The preprocessing techniques analyzed are advanced feature engineering and Synthetic Minority Over-sampling Technique (SMOTE) and Tomek links as resampling techniques and their combination. Various classifiers, including support vector machine (SVM), Naive Bayes (NB), Decision Tree (DT), Random Forest (RF), XGBoost, and Bidirectional Gated Recurrent Unit (BiGRU), were tested. The findings of this study show that preprocessing methods can significantly improve model performance, especially in the XGBoost model. Random Forest also gets the same results as XGBoost, but it can also work better without significant preprocessing. The best results were 0.8889, 0.8889, 0.6000, 0.9037, and 0.8790, respectively, for accuracy, recall, specificity, precision, and f1 on the Immunotherapy dataset, while on the Cryotherapy dataset, respectively, they were 0.8889, 0.8889, 0.6000, 0.9037, and 0.8790. This study confirms the potential of customized preprocessing and machine learning models to provide deep insights into treatment dynamics, ultimately improving the quality of diagnosis.
Downloads
References
R. Jain, R. Sawhney, and P. Mathur, “Feature Selection for Cryotherapy and Immunotherapy Treatment Methods Based on Gravitational Search Algorithm,” in 2018 International Conference on Current Trends towards Converging Technologies (ICCTCT), Mar. 2018, pp. 1–7. doi: 10.1109/ICCTCT.2018.8550983.
A. Cüvitoğlu and Z. Işik, “Evaluation Machine-Learning Approaches for Classification of Cryotherapy and Immunotherapy Datasets,” Int. J. Mach. Learn. Comput., vol. 8, no. 4, pp. 331–335, Aug. 2018, doi: 10.18178/ijmlc.2018.8.4.707.
S. Khatri, D. Arora, and A. Kumar, “Enhancing Decision Tree Classification Accuracy through Genetically Programmed Attributes for Wart Treatment Method Identification,” Procedia Comput. Sci., vol. 132, pp. 1685–1694, 2018, doi: 10.1016/j.procs.2018.05.141.
A. Y. Mahmoud, D. Neagu, D. Scrimieri, and A. R. A. Abdullatif, “Early diagnosis and personalised treatment focusing on synthetic data modelling: Novel visual learning approach in healthcare,” Comput. Biol. Med., vol. 164, no. August, p. 107295, Sep. 2023, doi: 10.1016/j.compbiomed.2023.107295.
O. Jaiyeoba, E. Ogbuju, O. T. Yomi, and F. Oladipo, “Development of a Model to Classify Skin Diseases using Stacking Ensemble Machine Learning Techniques,” J. Comput. Theor. Appl., vol. 2, no. 1, pp. 22–38, May 2024, doi: 10.62411/jcta.10488.
F. S. Gomiasti, W. Warto, E. Kartikadarma, J. Gondohanindijo, and D. R. I. M. Setiadi, “Enhancing Lung Cancer Classification Effectiveness Through Hyperparameter-Tuned Support Vector Machine,” J. Comput. Theor. Appl., vol. 1, no. 4, pp. 396–406, Mar. 2024, doi: 10.62411/jcta.10106.
M. A. Araaf, K. Nugroho, and D. R. I. M. Setiadi, “Comprehensive Analysis and Classification of Skin Diseases based on Image Texture Features using K-Nearest Neighbors Algorithm,” J. Comput. Theor. Appl., vol. 1, no. 1, pp. 31–40, Sep. 2023, doi: 10.33633/jcta.v1i1.9185.
F. Mustofa, A. N. Safriandono, A. R. Muslikh, and D. R. I. M. Setiadi, “Dataset and Feature Analysis for Diabetes Mellitus Classification using Random Forest,” J. Comput. Theor. Appl., vol. 1, no. 1, pp. 41–48, Jan. 2023, doi: 10.33633/jcta.v1i1.9190.
M. I. Akazue, I. A. Debekeme, A. E. Edje, C. Asuai, and U. J. Osame, “UNMASKING FRAUDSTERS: Ensemble Features Selection to Enhance Random Forest Fraud Detection,” J. Comput. Theor. Appl., vol. 1, no. 2, pp. 201–211, Dec. 2023, doi: 10.33633/jcta.v1i2.9462.
F. Omoruwou, A. A. Ojugo, and S. E. Ilodigwe, “Strategic Feature Selection for Enhanced Scorch Prediction in Flexible Polyurethane Form Manufacturing,” J. Comput. Theor. Appl., vol. 1, no. 3, pp. 346–357, Feb. 2024, doi: 10.62411/jcta.9539.
S. Ali, A. Hashmi, A. Hamza, U. Hayat, and H. Younis, “Dynamic and Static Handwriting Assessment in Parkinson’s Disease: A Synergistic Approach with C-Bi-GRU and VGG19,” J. Comput. Theor. Appl., vol. 1, no. 2, pp. 151–162, Dec. 2023, doi: 10.33633/jcta.v1i2.9469.
M. Diaz, M. Moetesum, I. Siddiqi, and G. Vessio, “Sequence-based dynamic handwriting analysis for Parkinson’s disease detection with one-dimensional convolutions and BiGRUs,” Expert Syst. Appl., vol. 168, no. August 2020, p. 114405, Apr. 2021, doi: 10.1016/j.eswa.2020.114405.
M. Misdram et al., “Analysis of Imputation Methods of Small and Unbalanced Datasets in Classifications using Naïve Bayes and Particle Swarm Optimization,” in 2020 International Seminar on Application for Technology of Information and Communication (iSemantic), Sep. 2020, pp. 115–119. doi: 10.1109/iSemantic50169.2020.9234225.
G. Charizanos, H. Demirhan, and D. İçen, “A Monte Carlo fuzzy logistic regression framework against imbalance and separation,” Inf. Sci. (Ny)., vol. 655, no. 1, p. 119893, Jan. 2024, doi: 10.1016/j.ins.2023.119893.
F. Khozeimeh, R. Alizadehsani, M. Roshanzamir, A. Khosravi, P. Layegh, and S. Nahavandi, “An expert system for selecting wart treatment method,” Comput. Biol. Med., vol. 81, no. January, pp. 167–175, Feb. 2017, doi: 10.1016/j.compbiomed.2017.01.001.
F. Khozeimeh et al., “Intralesional immunotherapy compared to cryotherapy in the treatment of warts,” Int. J. Dermatol., vol. 56, no. 4, pp. 474–478, Apr. 2017, doi: 10.1111/ijd.13535.
A. R. R. M. Khozeimeh Fahime and P. Layegh, “Immunotherapy Dataset.” 2018. doi: 10.24432/C5DC72.
A. R. R. M. Khozeimeh Fahime and P. Layegh, “Cryotherapy Dataset.” 2018. doi: 10.24432/C5FC7C.
D. Gibert, J. Planes, C. Mateu, and Q. Le, “Fusing feature engineering and deep learning: A case study for malware classification,” Expert Syst. Appl., vol. 207, no. June, p. 117957, Nov. 2022, doi: 10.1016/j.eswa.2022.117957.
A. M. Q. Farhan, S. Yang, A. Q. S. Al-Malahi, and M. A. Al-antari, “MCLSG:Multi-modal classification of lung disease and severity grading framework using consolidated feature engineering mechanisms,” Biomed. Signal Process. Control, vol. 85, no. January, p. 104916, Aug. 2023, doi: 10.1016/j.bspc.2023.104916.
N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, “SMOTE: Synthetic Minority Over-sampling Technique,” J. Artif. Intell. Res., vol. 16, no. February 2017, pp. 321–357, Jun. 2002, doi: 10.1613/jair.953.
F. O. Aghware et al., “Enhancing the Random Forest Model via Synthetic Minority Oversampling Technique for Credit-Card Fraud Detection,” J. Comput. Theor. Appl., vol. 1, no. 4, pp. 407–420, Mar. 2024, doi: 10.62411/jcta.10323.
N. Cahyana, S. Khomsah, and A. S. Aribowo, “Improving Imbalanced Dataset Classification Using Oversampling and Gradient Boosting,” in 2019 5th International Conference on Science in Information Technology (ICSITech), Oct. 2019, pp. 217–222. doi: 10.1109/ICSITech46713.2019.8987499.
N. Reska and K. Tsabita, “Comparison of KNN, naive bayes, and decision tree methods in predicting the accuracy of classification of immunotherapy dataset,” J. Student Res. Explor., vol. 1, no. 2, pp. 104–121, Jul. 2023, doi: 10.52465/josre.v1i2.170.
A. Ali, M. Abu-Elkheir, A. Atwan, and M. Elmogy, “Missing values imputation using Fuzzy K-Top Matching Value,” J. King Saud Univ. - Comput. Inf. Sci., vol. 35, no. 1, pp. 426–437, Jan. 2023, doi: 10.1016/j.jksuci.2022.12.011.
M. S. Sunarjo, H. Gan, and D. R. I. M. Setiadi, “High-Performance Convolutional Neural Network Model to Identify COVID-19 in Medical Images,” J. Comput. Theor. Appl., vol. 1, no. 1, pp. 19–30, Aug. 2023, doi: 10.33633/jcta.v1i1.8936.
E. B. Wijayanti, D. R. I. M. Setiadi, and B. H. Setyoko, “Dataset Analysis and Feature Characteristics to Predict Rice Production based on eXtreme Gradient Boosting,” J. Comput. Theor. Appl., vol. 1, no. 3, pp. 299–310, Feb. 2024, doi: 10.62411/jcta.10057.
A. Zheng, Feature Engineering for Machine Learning: Principles and Techniques for Data Scientists. Sebastopol, CA: O’Reilly Media, 2018.
Y. Chachoui, N. Azizi, R. Hotte, and T. Bensebaa, “Enhancing algorithmic assessment in education: Equi-fused-data-based SMOTE for balanced learning,” Comput. Educ. Artif. Intell., vol. 6, p. 100222, Jun. 2024, doi: 10.1016/j.caeai.2024.100222.
R. M. Pereira, Y. M. G. G. Costa, C. N. Silla Jr., and C. N. Silla, “MLTL: A multi-label approach for the Tomek Link undersampling algorithm,” Neurocomputing, vol. 383, pp. 95–105, Mar. 2020, doi: 10.1016/j.neucom.2019.11.076.
F. M. Firnando, D. R. I. M. Setiadi, A. R. Muslikh, and Syahroni Wahyu Iriananda, “Analyzing InceptionV3 and InceptionResNetV2 with Data Augmentation for Rice Leaf Disease Classification,” J. Futur. Artif. Intell. Technol., vol. 1, no. 1, pp. 1–11, 2024.
R. K. Rachman, D. R. I. M. Setiadi, A. Susanto, K. Nugroho, and H. M. M. Islam, “Enhanced Vision Transformer and Transfer Learning Approach to Improve Rice Disease Recognition,” J. Comput. Theor. Appl., vol. 1, no. 4, pp. 446–460, Apr. 2024, doi: 10.62411/jcta.10459.
T. R. Noviandy, K. Nisa, G. M. Idroes, I. Hardi, and N. R. Sasmita, “Classifying Beta-Secretase 1 Inhibitor Activity for Alzheimer’s Drug Discovery with LightGBM,” J. Comput. Theor. Appl., vol. 1, no. 4, pp. 358–367, Mar. 2024, doi: 10.62411/jcta.10129.
M. T. H. Khan Tusar, M. T. Islam, A. H. Sakil, M. N. H. N. Khandaker, and M. M. Hossain, “An Intelligent Telediagnosis of Acute Lymphoblastic Leukemia using Histopathological Deep Learning,” J. Comput. Theor. Appl., vol. 2, no. 1, pp. 1–12, May 2024, doi: 10.62411/jcta.10358.
M. Çiftçi, M. U. Türkdamar, and C. Öztürk, “Leveraging YOLO Models for Safety Equipment Detection on Construction Sites,” J. Comput. Theor. Appl., vol. 1, no. 4, pp. 492–506, May 2024, doi: 10.62411/jcta.10453.
D. R. I. M. Setiadi, K. Nugroho, A. R. Muslikh, S. Wahyu, and A. A. Ojugo, “Integrating SMOTE-Tomek and Fusion Learning with XGBoost Meta-Learner for Robust Diabetes Recognition,” J. Futur. Artif. Intell. Technol., vol. 1, no. 1, pp. 23–38, 2024.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 De Rosal Ignatius Moses Setiadi, Hussain Md Mehedul Islam, Gustina Alfa Trisnapradika, Wise Herowati
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
