Text emotion recognition based on deep learning and attention with whale optimization algorithm

Abstract

Text emotion recognition (TER) represents one of the crucial tasks in natural language processing (NLP), and it is highly important for many applications. To improve the performance of TER, advanced deep learning (DL) model GRU-BiGRU-CNN-Att is presented in this research. It is a combination of gated recurrent units (GRU), bidirectional gated recurrent units (BiGRU) with a convolutional neural network (CNN), and an attention mechanism. Using a GRU, BiGRU, and CNN as part of a deep feature extraction model, combined with an attention mechanism that gives important information different weights, the method that is proposed in the present work enhances the quality of the word vectors and leads to increasing sentiment analysis judgment accuracy. The whale optimization algorithm (WOA), which selects the most informative features for further enhancing the model, is used lastly for the optimization of the feature selection process. After such optimization, those chosen features are trained on a multi-layer perceptron (MLP), successfully combining machine learning (ML) and DL approaches for improving TER. A varied corpus of tweets, sentences, and dialogues had been used in the present work for the assessment of the performance of the suggested model. The proposed method achieves 83.76% accuracy in emotion recognition.