Effective modelling of human expressive states from voice by adaptively tuning the neuro-fuzzy inference system

Surjyo Narayana Panigrahi, Niharika Pattanaik, Hemanta Kumar Palo


This paper aims to develop efficient speech-expressive models using the adaptively tuning neuro-fuzzy inference system (ANFIS). The developed models differentiate a high-arousal happiness state from a low-arousal sadness state from the benchmark Berlin (EMODB) database. The proposed low-cost flexible developed algorithms are self-tunable and can address several vivid real-world issues such as home tutoring, banking, and finance sectors, criminal investigations, psychological studies, call centers, cognitive and biomedical sciences. The work develops the proposed structures by formulating several novel feature vectors comprising both time and frequency information. The features considered are pitch (F0), the standard deviation of pitch (SDF0), autocorrelation coefficient (AC), log-energy (E), jitter, shimmer, harmonic to noise ratio (HNR), spectral centroid (SC), spectral roll-off (SR), spectral flux (SF), and zero-crossing rate (ZCR). to alleviate the issues of the curse of dimensionality associated with the frame-level extraction, the features are extracted at the utterance level. Several performance parameters have been computed to validate the individual time and frequency models. Further, the ANFIS models are tested for their efficacy in a combinational platform. The chosen features are complementary and the augmented vectors have indeed shown improved performance with more available information as revealed by our results.


Adaptive neuro-fuzzy inference; Feature extraction; Human expressive states; Modeling; Root mean square error;

Full Text:


DOI: http://doi.org/10.11591/ijai.v13.i1.pp185-194


  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

IAES International Journal of Artificial Intelligence (IJ-AI)
ISSN/e-ISSN 2089-4872/2252-8938 
This journal is published by the Institute of Advanced Engineering and Science (IAES) in collaboration with Intelektual Pustaka Media Utama (IPMU).

View IJAI Stats