Comparison of Multinomial Naïve Bayes and Bernoulli Naïve Bayes Methods in Sentiment Analysis of National Team Naturalization Based on Comments on Instagram

Authors

  • Andrianus Dwi Haryo Universitas Sanata Dharma
  • J.B. Budi Darmawan Universitas Sanata Dharma

Keywords:

sentiment analysis, instagram, multinomial naïve bayes, bernoulli naïve bayes, naturalization of foreign players

Abstract

Football is the most popular sport in Indonesia, with the National Team serving as a symbol of national pride. One of the most debated issues is the naturalization of foreign players to strengthen the team. Public opinions on this topic are widely expressed on social media, especially Instagram. This study aims to analyze sentiment from 4,258 Instagram comments related to the naturalization issue by comparing the performance of Multinomial Naïve Bayes and Bernoulli Naïve Bayes Methods. The analysis process includes preprocessing, translation using the Google Translate API, sentiment labeling with VADER, TF-IDF vectorization, and data balancing using SMOTE. The classification performance is evaluated using a confusion matrix with metrics such as accuracy, precision, recall, and F1-score. The results show that Multinomial Naïve Bayes achieves better performance with 74.65% accuracy, 75.96% precision, 74.65% recall, and 74.32% F1-score under 10-fold cross-validation and alpha 0.01 compared to Bernoulli Naïve Bayes.

References

B. Pradiksa and D. A. Prianto, “Persepsi masyarakat terhadap sepakbola Indonesia di masa pandemi Covid-19,” Jurnal Prestasi Olahraga, vol. 5, no. 2, pp. 53–59, 2022.

D. R. P. Jaya and S. Lestari, “Analisis Sentimen Naturalisasi Tim Nasional Indonesia U-23 di Era Shin Tae-yong Menggunakan Algoritma Naïve Bayes dan K-Nearest Neighbors,” Jurnal Indonesia: Manajemen Informatika dan Komunikasi, vol. 5, no. 3, pp. 3262–3277, 2024.

J. Zhao, K. Liu, and L. Xu, “Sentiment analysis: Mining opinions, sentiments, and emotions.” MIT Press One Rogers Street, Cambridge, MA 02142-1209, USA journals-info …, 2016.

C. D. Manning, An introduction to information retrieval. 2009.

A. TEGAR, N. E. FRESIA, and M. HABIBI, “PEMETAAN OPINI PUBLIK MENGGUNAKAN DATA MINING: STUDI KASUS NATURALISASI PEMAIN SEPAK BOLA DENGAN K-MEANS DAN NAIVE BAYES CLASSIFIER,” INDONESIAN JOURNAL ON DATA SCIENCE Учредители: Universitas Jenderal Achmad Yani Yogyakarta, vol. 2, no. 1, pp. 43–50, 2024.

A. S. Adhityas, “Analisis Sentimen Terhadap Program Naturalisasi Timnas Indonesia Pada X Menggunakan Algoritma Naive Bayes,” eProceedings of Engineering, vol. 12, no. 2, pp. 1–9, 2025.

B. R. Adji and J. B. B. Darmawan, “ANALISIS SENTIMEN TERHADAP KULIAH DARING MENGGUNAKAN MULTINOMIAL NAIVE BAYES DENGAN SELEKSI FITUR INFORMATION GAIN,” in The 2nd Seminar Nasional dan Prosiding Scitech 2023, 2023.

N. S. Wardani, A. Prahutama, and P. Kartikasari, “Analisis sentimen pemindahan ibu kota negara dengan klasifikasi Naïve Bayes untuk model Bernoulli dan Multinomial,” Jurnal Gaussian, vol. 9, no. 3, pp. 237–246, 2020.

S. Jansen, Hands-On Machine learning for Algorithmic Trading: Design and implement investment strategies based on smart algorithms that learn from data using Python. Packt Publishing Ltd, 2018.

S. T. Jishan, R. I. Rashu, N. Haque, and R. M. Rahman, “Improving accuracy of students’ final grade prediction model using optimal equal width binning and synthetic minority over-sampling technique,” Decision Analytics, vol. 2, no. 1, p. 1, 2015.

J. Han, J. Pei, and H. Tong, Data mining: concepts and techniques. Morgan kaufmann, 2022.

Published

2025-11-25

How to Cite

Haryo, A. D. and Darmawan, J. B. (2025) “Comparison of Multinomial Naïve Bayes and Bernoulli Naïve Bayes Methods in Sentiment Analysis of National Team Naturalization Based on Comments on Instagram”, ReTII, pp. 262–268. Available at: https://journal.itny.ac.id/index.php/ReTII/article/view/6361 (Accessed: 4June2026).