Optimizing Sentiment Analysis on Imbalanced Hotel Review Data Using SMOTE and Ensemble Machine Learning Techniques

Open

Pandu Pratama Putra, M. Khairul Anam, Andi Supriadi Chan, Abrar Hadi, Nofri Hendri, Alkadri Masnur

2025 Journal of Applied Data Sciences Vol. 6 Issue 2 Article Cited by 12 SDG 12SDG 16SDG 17 Quartile

Abstract

This research addresses the challenge of imbalanced sentiment classes in hotel review datasets obtained from Traveloka by integrating SMOTE (Synthetic Minority Oversampling Technique) with ensemble machine learning methods. The study aimed to enhance the classification of Positive, Negative, and Neutral sentiments in customer reviews. Data preprocessing techniques, including tokenization, stemming, and stopword removal, prepared the textual data for analysis. Various machine learning models—CART, KNN, Naive Bayes, and Random Forest—were evaluated individually and in ensemble configurations such as Bagging, Stacking, Soft Voting, and Hard Voting. The Stacking ensemble approach, utilizing Logistic Regression as a meta-classifier, demonstrated superior performance with an accuracy, precision, recall, and F1-score of 88%, outperforming Bagging (86%), Hard Voting (84%), and Soft Voting (81%). The findings highlight the effectiveness of SMOTE in balancing sentiment classes, particularly improving the classification of underrepresented Neutral and Negative categories. The novelty of this study lies in the comprehensive use of ensemble techniques combined with SMOTE, which significantly enhanced prediction stability and accuracy compared to previous approaches. These results provide valuable insights into leveraging advanced machine learning techniques for sentiment analysis, offering practical implications for improving customer experience and service quality in the hospitality industry. © Authors.

Affiliations

Department of Informatics Engineering, Universitas Lancang Kuning, Jl. Yos Sudarso, Pekanbaru, 28266, Indonesia; Department of Informatics, Universitas Samudra, Jl, Prof. Dr. Syarief Thayeb, Langsa, 24416, Indonesia; Department of Graphic Multimedia Engineering Technology, Politeknik Negeri Medan, Jl. Almamater, Medan, 20155, Indonesia; Department of Informatics Management, Politeknik LP3I Kampus Padang, Jl. By Pass km.7,, Padang, 25147, Indonesia; Department of Educational Technology, Universitas Negeri Padang, Jl. Prof. Dr. Hamka,, Padang, 25011, Indonesia

Research at a Glance

Premium content — register to unlock

Research at a Glance

Register to unlock

Topics & SDG Alignment

Premium content — register to unlock

Topics & SDG Alignment

Register to unlock

Collaboration

Premium content — register to unlock

Collaboration

Register to unlock

Author Profile (Selected)

Premium content — register to unlock

Author Profile (Selected)

Register to unlock

References Overview

Premium content — register to unlock

References Overview

Register to unlock

Journal & Source

Premium content — register to unlock

Journal & Source

Register to unlock

Metadata & Integrity

Premium content — register to unlock

Metadata & Integrity

Register to unlock