Integrating gait and speech dynamics methodologies for enhanced stuttering detection across diverse datasets
Abstract
Stuttering manifests as involuntary interruptions in the fluency of speech, often involving repetitions, prolongations, or blocks of sounds or syllables. These disruptions can significantly impact effective communication and psychosocial well-being. This research introduces a comprehensive system for speech impairment detection and gait analysis. Speech impairment, with a primary focus on stammer recognition, presents a multifaceted challenge in the field of speech processing. Stammers can manifest in various forms and detecting them accurately is a complex task. Our proposed methodology revolves around the development of StEnsembleNet, a neural network designed to learn spectral features at the frame level, enabling precise and efficient identification of speech impediments. Additionally, we extend our system's capabilities to the domain of gait analysis, leveraging a novel adaptive graph topology convolution network (AGT-ConvNet) for skeletal motion and visually enhanced topological learning to adapt to diverse visual environments and enhance the recognition of gait patterns. This research not only contributes to the field of speech therapy but also offers potential applications in healthcare and motion analysis.
Keywords
Adaptive graph topology convolution network; Healthcare; Neural network; Speech impairment; Speech therapy
Full Text:
PDFDOI: http://doi.org/10.11591/ijai.v13.i4.pp4869-4882
Refbacks
- There are currently no refbacks.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
IAES International Journal of Artificial Intelligence (IJ-AI)
ISSN/e-ISSN 2089-4872/2252-8938
This journal is published by the Institute of Advanced Engineering and Science (IAES) in collaboration with Intelektual Pustaka Media Utama (IPMU).