Evaluation of Machine Learning Algorithms in Sentiment Analysis of the Satu Sehat Application

Marwan Suhendra; Badariatul Lailiah; Yanto Yanto; Lady Agustin Fitriana

doi:10.59934/jaiea.v5i2.1816

Authors

Marwan Suhendra Universitas Bina Sarana Informatika
Badariatul Lailiah Universitas Bina Sarana Informatika
Yanto Yanto Universitas Bina Sarana Informatika
Lady Agustin Fitriana Universitas Bina Sarana Informatika

DOI:

https://doi.org/10.59934/jaiea.v5i2.1816

Keywords:

Sentiment Analysis, Satu Sehat, Support Vector Machine (SVM), Naïve Bayes (NB), K-Nearest Neighbor (K-NN)

Abstract

This study aims to analyze and compare the performance of three sentiment classification algorithms—Support Vector Machine (SVM), Naïve Bayes (NB), and K-Nearest Neighbor (K-NN)—in classifying user reviews of the Satu Sehat application. The data preprocessing stage involves several steps, including text cleaning through normalization, removal of punctuation, numbers, and irrelevant characters, as well as the elimination of stopwords. Subsequently, stemming is performed to reduce words to their root forms. Feature extraction is conducted using the CountVectorizer method with a bag-of-words approach, which converts textual data into numerical representations. The dataset is then divided into training and testing subsets using an 80:20 train-test split ratio. Model performance is evaluated through a confusion matrix, producing key evaluation metrics such as accuracy, precision, recall, and F1-score. Based on the results of testing 9,192 user reviews, the SVM algorithm with a linear kernel demonstrated the best overall performance compared to NB and K-NN, as indicated by the highest accuracy score. These findings suggest that SVM is more effective in handling high-dimensional textual features, making it a highly suitable algorithm for sentiment analysis of digital health application reviews, particularly those related to Satu Sehat.

Downloads

Download data is not yet available.

References

Y. M. Geasela, M. F. Isputrawan, F. S. Lee, and E. Christian, “SISTEM PENDAFTARAN TERINTEGRASI SATUSEHAT UNTUK AKSES LAYANAN KESEHATAN MENUJU INDONESIA SEHAT 2045,” J. Inform., vol. 8, no. 4, 2024.

A. Nurian, “ANALISIS SENTIMEN ULASAN PENGGUNA APLIKASI GOOGLE PLAY MENGGUNAKAN NAÏVE BAYES,” J. Inform. Dan Tek. Elektro Terap., vol. 11, no. 3s1, Sept. 2023, doi: 10.23960/jitet.v11i3s1.3348.

Lady Agustin Fitriana, M. Fahmi Julianto, R. Dahlia, M. Rifqi Firdaus, and A. Fazriansyah, “Analisis Ulasan Konsumen sebagai Data Non-Keuangan dalam Sistem Informasi Akuntansi,” Profitabilitas, vol. 5, no. 1, pp. 64–74, July 2025, doi: 10.31294/profitabilitas.v5i1.8269.

Israt Jahan, Md Nakibul Islam, Md Mahadi Hasan, and Md Rafiuddin Siddiky, “Comparative analysis of machine learning algorithms for sentiment classification in social media text,” World J. Adv. Res. Rev., vol. 23, no. 3, pp. 2842–2852, Sept. 2024, doi: 10.30574/wjarr.2024.23.3.2983.

F. Matheos Sarimole and K. Kudrat, “Analisis Sentimen Terhadap Aplikasi Satu Sehat Pada Twitter Menggunakan Algoritma Naive Bayes Dan Support Vector Machine: Analisis Sentimen,” J. Sains Dan Teknol., vol. 5, no. 3, pp. 783–790, Feb. 2024, doi: 10.55338/saintek.v5i3.2702.

A. Putri et al., “Komparasi Algoritma K-NN, Naive Bayes dan SVM untuk Prediksi Kelulusan Mahasiswa Tingkat Akhir: Comparison of K-NN, Naive Bayes and SVM Algorithms for Final-Year Student Graduation Prediction,” MALCOM Indones. J. Mach. Learn. Comput. Sci., vol. 3, no. 1, pp. 20–26, May 2023, doi: 10.57152/malcom.v3i1.610.

A. Hendra and F. Fitriyani, “Analisis Sentimen Review Halodoc Menggunakan Nai ̈ve Bayes Classifier,” JISKA J. Inform. Sunan Kalijaga, vol. 6, no. 2, pp. 78–89, May 2021, doi: 10.14421/jiska.2021.6.2.78-89.

P. Nabila, F. Wajidi, and W. Firgiawan, “Analisis Algoritma K-Nearest Neighbor dan Naive Bayes pada Kebijakan Perkuliahan Online dengan Multi Bahasa,” Techno.Com, vol. 24, no. 2, pp. 524–542, May 2025, doi: 10.62411/tc.v24i2.12656.

F. M. N. Akbar, “Metode KNN (K-Nearest Neighbor) untuk Menentukan Kualitas Air,” J. Tekno Kompak, vol. 18, no. 1, p. 28, Feb. 2024, doi: 10.33365/jtk.v18i1.3241.

M. H. Arfian et al., “Analisis Sentimen Pada Media Sosial Menggunakan Metode Support Vector Machine,” J. Ilmu Tek. Dan Komput., vol. 9, no. 1, pp. 1–6, Jan. 2025.

Fauziah, M. A. Tiro, and Ruliana, “Comparison of k-Nearest Neighbor (k-NN) and Support Vector Machine (SVM) Methods for Classification of Poverty Data in Papua,” ARRUS J. Math. Appl. Sci., vol. 2, no. 2, pp. 83–91, Mar. 2022, doi: 10.35877/mathscience741.

S. K. P. Loka and A. Marsal, “Perbandingan Algoritma K-Nearest Neighbor dan Naïve Bayes Classifier untuk Klasifikasi Status Gizi Pada Balita: Comparison Algorithm of K-Nearest Neighbor and Naïve Bayes Classifier for Classifying Nutritional Status in Toddlers,” MALCOM Indones. J. Mach. Learn. Comput. Sci., vol. 3, no. 1, pp. 8–14, May 2023, doi: 10.57152/malcom.v3i1.474.

M. H. Asnawi, I. Firmansyah, R. Novian, and R. S. Pontoh, “Perbandingan Algoritma Naïve Bayes, K-NN, dan SVM dalam Pengklasifikasian Sentimen Media Sosial,” 2021.

P. D. Silitonga and R. Damanik, “Perbandingan Algoritma k-Nearest Neighbors (k-NN) dan Support Vector Machines (SVM) untuk Klasifikasi Pengenalan Citra Wajah,” J. ICT Inf. Commun. Technol., vol. 20, no. 1, pp. 186–191, July 2021, doi: 10.36054/jict-ikmi.v20i1.354.

A. Tangkelayuk, “The Klasifikasi Kualitas Air Menggunakan Metode KNN, Naïve Bayes, dan Decision Tree,” JATISI J. Tek. Inform. Dan Sist. Inf., vol. 9, no. 2, pp. 1109–1119, June 2022, doi: 10.35957/jatisi.v9i2.2048.

J. Wibisono, A. Suharsono, and S. H. Wijoyo, “PERBANDINGAN KINERJA METODE NAIVE BAYES DAN K- NEAREST NEIGHBOR UNTUK KLASIFIKASI PEKERJAAN BERDASARKAN NILAI MATA KULIAH (STUDI KASUS: ALUMNI PROGRAM STUDI PENDIDIKAN TEKNOLOGI INFORMASI FAKULTAS ILMU KOMPUTER UNIVERSITAS BRAWIJAYA)”.