Comprehensive Analysis of TF-IDF and Word2Vec-Based Text Feature Representation on Support Vector Machine Performance in Sentiment Analysis of Telemedicine Reviews

Authors

  • Citra Ayu Tri Lestari ITSK RS dr. Soepraoen Malang
  • Ahsanun Naseh Khudori ITSK RS dr. Soepraoen Malang
  • Risqy Siwi Pradini ITSK RS dr. Soepraoen Malang

DOI:

https://doi.org/10.21512/emacsjournal.v8i2.16081

Keywords:

Sentiment Analysis, Telemedicine, TF-IDF, Word2vec, Support Vector Machine

Abstract

User reviews of telemedicine applications provide valuable insights into user satisfaction and service quality. Accurate sentiment analysis of these reviews depends greatly on the text representation method used before classification. Although TF-IDF and Word2Vec have been widely applied in sentiment analysis, their comparative performance on Indonesian-language telemedicine reviews with a highly imbalanced sentiment distribution has not been sufficiently investigated. So, in order to analyze the sentiment of Halodoc application evaluations using the Support Vector Machine (SVM) classifier, this study analyzes the performance of TF-IDF and Word2Vec, two text representation approaches. The Google Play Store was combined from January 2024 to October 2025 for a grand total of 10,443 reviews. After implementing user-rated automatic sentiment labeling, 6,574 valid reviews were obtained using Indonesian-specific preprocessing that included case folding, cleaning, stopword removal, and stemming. Stratified 5-fold cross-validation using recall, accuracy, precision, and F1-score metrics was used to test the models. Word2Vec only managed 75% accuracy, 78% precision, 79% recall, and 78% F1-score in the experiments, but TF-IDF achieved 90% accuracy, 89% precision, 90% recall, and 89% F1-score. TF-IDF outperformed Word2Vec because frequency-based features are more effective in representing short review texts, whereas Word2Vec generally requires a substantially larger corpus to learn robust semantic representations. These findings provide empirical evidence for selecting appropriate text representation methods in Indonesian telemedicine sentiment analysis and contribute practical guidance for developing more accurate digital healthcare opinion mining systems.

Dimensions

Author Biographies

Citra Ayu Tri Lestari, ITSK RS dr. Soepraoen Malang

Department of Informatics, Faculty of Science and Technology

Ahsanun Naseh Khudori, ITSK RS dr. Soepraoen Malang

Department of Informatics, Faculty of Science and Technology

Risqy Siwi Pradini, ITSK RS dr. Soepraoen Malang

Department of Informatics, Faculty of Science and Technology

References

Alexandra, S., Handayani, P. W., & Azzahro, F. (2021). Indonesian hospital telemedicine acceptance model: the influence of user behavior and technological dimensions. Heliyon, 7(12). https://doi.org/10.1016/j.heliyon.2021.e08599

Cahyani, D. E., & Patasik, I. (2021a). Performance comparison of tf-idf and word2vec models for emotion text classification. Bulletin of Electrical Engineering and Informatics, 10(5), 2780–2788. https://doi.org/10.11591/eei.v10i5.3157

Edi Sutoyo, & Muhammad Cekas Permana. (2025). work contributes to enhancing telemedicine service quality and advancing Indonesian natural language processing re-search. Elsevier Inc. https://doi.org/10.17632/j8yjvsyr9p.1

Farah, F. R., Putri, A. W., & Rani, T. B. (2023). Analisis Pengaruh Keputusan Penggunaan Telemedicine Halodoc di Kota Bogor. Manajemen Kesehatan Indonesia. https://doi.org/10.14710/jmki.11.2.2023.190-202

Faruqui, N., Thatoi, P., Choudhary, R., Roncevic, I., Alqahtani, H., Sarker, I. H., & Khanam, S. (2024). AI-Analyst: An AI-Assisted SDLC Analysis Framework for Business Cost Optimization. IEEE Access, 12, 195188–195203. https://doi.org/10.1109/ACCESS.2024.3519423

Fitriati, L. R., Guntara, R. G., & Purwaamijaya, B. M. (2025). Analisis Sentimen Ulasan Pengguna GoPay di Google Play Store menggunakan Model IndoELECTRA. Jurnal Algoritma, 22(2). https://doi.org/10.33364/algoritma/v.22-2.3053

Gretya Sinaga, A., & Pribadi, O. (2026). Comprehensive Comparison of TF-IDF and Word2Vec in Product Sentiment Classification Using Machine Learning Models. In Journal of Applied Informatics and Computing (JAIC) (Vol. 10, Number 1). https://doi.org/10.30871/jaic.v10i1.11582

Imaduddin, H., Yusfida A’la, F., & Nugroho, Y. S. (n.d.). Sentiment Analysis in Indonesian Healthcare Applications using IndoBERT Approach. In IJACSA) International Journal of Advanced Computer Science and Applications (Vol. 14, Number 8). Retrieved www.ijacsa.thesai.org. https://doi.org/10.14569/IJACSA.2023.0140813

Kichloo, A., Albosta, M., Dettloff, K., Wani, F., El-Amir, Z., Singh, J., Aljadah, M., Chakinala, R. C., Kanugula, A. K., Solanki, S., & Chugh, S. (2020). Telemedicine, the current COVID-19 pandemic and the future: a narrative review and perspectives moving forward in the USA. In Family Medicine and Community Health (Vol. 8, Number 3). BMJ Publishing Group. https://doi.org/10.1136/fmch-2020-000530

Mahdavi, S., Fekri, M., Mohammadi-Sarab, S., Mehmandoost, M., & Zarei, E. (2025). The use of telemedicine in family medicine: a scoping review. In BMC Health Services Research (Vol. 25, Number 1). BioMed Central Ltd. https://doi.org/10.1186/s12913-025-12449-7

Mandhasiya, D. G., Murfi, H., & Bustamam, A. (2024). The hybrid of BERT and deep learning models for Indonesian sentiment analysis. Indonesian Journal of Electrical Engineering and Computer Science, 33(1), 591–602. https://doi.org/10.11591/ijeecs.v33.i1.pp591-602

Monika, P., Kulkarni, C., Harish Kumar, N., Shruthi, S., & Vani, V. (2022). Machine learning approaches for sentiment analysis. International Journal of Health Sciences, 1286–1300. https://doi.org/10.53730/ijhs.v6ns4.6119

Palanivinayagam, A., El-Bayeh, C. Z., & Damaševičius, R. (2023). Twenty Years of Machine-Learning-Based Text Classification: A Systematic Review. Algorithms, 16(5). https://doi.org/10.3390/a16050236

Rahmanda, R., & Setiawan, E. B. (2022). Word2Vec on Sentiment Analysis with Synthetic Minority Oversampling Technique and Boosting Algorithm. Jurnal RESTI, 6(4), 599–605. https://doi.org/10.29207/resti.v6i4.4186

Rianto, Mutiara, A. B., Wibowo, E. P., & Santosa, P. I. (2021). Improving the accuracy of text classification using stemming method, a case of non-formal Indonesian conversation. Journal of Big Data, 8(1). https://doi.org/10.1186/s40537-021-00413-1

Rifaldy, F., Sibaroni, Y., & Prasetiyowati, S. S. (2025). Effectiveness of Word2Vec and TF-IDF in Sentiment Classification on Online Investment Platforms Using Support Vector Machine. JIPI (Jurnal Ilmiah Penelitian Dan Pembelajaran Informatika), 10(2), 863–874. https://doi.org/10.29100/jipi.v10i2.6055

Royyan, A. R., & Setiawan, E. B. (2022). Feature Expansion Word2Vec for Sentiment Analysis of Public Policy in Twitter. Jurnal RESTI, 6(1), 78–84. https://doi.org/10.29207/resti.v6i1.3525

Sarica, S., & Luo, J. (2021). Stopwords in technical language processing. PLoS ONE, 16(8 August). https://doi.org/10.1371/journal.pone.0254937

Tan, K. L., Lee, C. P., & Lim, K. M. (2023). A Survey of Sentiment Analysis: Approaches, Datasets, and Future Research. In Applied Sciences (Switzerland) (Vol. 13, Number 7). MDPI. https://doi.org/10.3390/app13074550

Wijaya, J. H., Octavius, G. S., & Hwei, L. R. Y. (2022). A LITERATURE REVIEW OF TELEMEDICINE IN INDONESIA: PAST, PRESENT, AND FUTURE PROSPECTIVE. In Indonesian Journal of Health Administration (Vol. 10, Number 2, pp. 261–272). Airlangga University. https://doi.org/10.20473/jaki.v10i2.2022.261-272

Zhan, Z. (2025). Comparative Analysis of TF-IDF and Word2Vec in Sentiment Analysis: A Case of Food Reviews. ITM Web of Conferences, 70, 02013. https://doi.org/10.1051/itmconf/20257002013

Zhang, L. (2025). Features extraction based on Naive Bayes algorithm and TF-IDF for news classification. PLOS ONE, 20(7 July). https://doi.org/10.1371/journal.pone.0327347

Zhou, J., Ye, Z., Zhang, S., Geng, Z., Han, N., & Yang, T. (2024). Investigating response behavior through TF-IDF and Word2vec text analysis: A case study of PISA 2012 problem-solving process data. Heliyon, 10(16). https://doi.org/10.1016/j.heliyon.2024.e3594

Downloads

Published

2026-10-26

How to Cite

Lestari, C. A. T., Khudori, A. N., & Pradini, R. S. (2026). Comprehensive Analysis of TF-IDF and Word2Vec-Based Text Feature Representation on Support Vector Machine Performance in Sentiment Analysis of Telemedicine Reviews. Engineering, MAthematics and Computer Science Journal (EMACS), 8(2), 205–214. https://doi.org/10.21512/emacsjournal.v8i2.16081

Issue

Section

Articles
Abstract 5  .
PDF downloaded 5  .