Generative Indonesian chatbot for university major selection using transformers embedding

Abstract

Selecting a university major is a crucial decision that impacts students' future career paths and personal fulfillment. Traditional guidance methods often lack the personalization and timeliness needed to support students effectively. This study explores the use of Indonesian generative artificial intelligence (AI) chatbots and transformer embeddings to enhance decision-making for university major selection. By leveraging advanced AI techniques, such as bidirectional encoder representations from transformers (BERT) and Gemini embeddings, the research aims to provide personalized, interactive, and contextually relevant guidance. Experiments showed that BERT embeddings achieved the highest accuracy, with recurrent neural network (RNN) and long short-term memory (LSTM) models also performing well but facing issues with overfitting. Gemini embeddings provided strong performance but slightly less effective than BERT. The findings suggest that BERT-based models with RNN are superior for developing decision-support systems in 92% accuracy. Future work should focus on further optimization and integration of user feedback to ensure the relevance and effectiveness of these AI tools in educational settings.