Acoustic and perceptual characteristics of emotional speech in adolescents aged 12–14 with intellectual disabilities and typical development: comparative analysis

Cover Page

Cite item

Full Text

Open Access Open Access
Restricted Access Access granted
Restricted Access Subscription or Fee Access

Abstract

The aim of this study is to investigate the manifestation of emotional states in the speech of typically developing (TD) adolescents and adolescents with intellectual disabilities (ID). Emotional speech from 25 adolescents was analyzed during the reading of nonsense texts in the emotional states of “joy — neutral — sadness — anger — fear”. Spectrographic analysis of children's speech was conducted using the software “Cool Edit Pro 2.0”. The following parameters were measured: duration; pitch values (F0); minimum (F0min) and maximum (F0max) pitch values; pitch range values (F0max–F0min); intensity values for the phrase, stressed word, and stressed vowel. A perceptual experiment involving 10 adult listeners was conducted. Differences in acoustic characteristics of emotional speech were identified between TD and ID adolescents: word and vowel duration; minimum pitch values for words and vowels. According to the results of the perceptual experiment, TD adolescents demonstrated a better ability to express sadness and anger in their voice compared to adolescents with ID.

About the authors

E. A. Kleshnev

Saint Petersburg State University

Email: kleshnev.egor@gmail.com
Universitetskaya emb. 7-9, Saint Petersburg, 199034, Russia

E. E. Lyakso

Saint Petersburg State University

Author for correspondence.
Email: kleshnev.egor@gmail.com
Universitetskaya emb. 7-9, Saint Petersburg, 199034, Russia

References

  1. Juslin P.N., Laukka P. Communication of emotions in vocal expression and music performance: different channels, same code? // Psychol. Bull. 2003. V. 129. № 5. P. 770–814. https://doi.org/10.1037/0033-2909.129.5.770
  2. Kamiloğlu R.G., Fischer A.H., Sauter D.A. Good vibrations: A review of vocal expressions of positive emotions // Psychon. Bull. Rev. 2020. V. 27. № 2. P. 237–265. https://doi.org/10.3758/S13423-019-01701-X
  3. Papakostas M., Siantikos G., Giannakopoulos T., Spyrou E., Sgouropoulos D. Recognizing Emotional States Using Speech Information // Adv. Exp. Med. Biol. 2017. V. 989. P. 155–164. https://doi.org/10.1007/978-3-319-57348-9_13
  4. Keshtiari N., Kuhlmann M., Eslami M., Klann-Delius G. Recognizing emotional speech in Persian: a validated database of Persian emotional speech (Persian ESD) // Behav. Res. Methods. 2015. V. 47. № 1. P. 275–294. https://doi.org/10.3758/S13428-014-0467-X
  5. Scherer K.R. Expression of emotion in voice and music // J. Voice. 1995. V. 9. № 3. P. 235–248. https://doi.org/10.1016/S0892-1997(05)80231-0
  6. Scherer K.R. Vocal communication of emotion: A review of research paradigms // Speech Commun. 2003. V. 40. № 2–3. P. 227–256. https://doi.org/10.1016/S0167-6393(02)00084-5
  7. Морозов В.П. Эмоциональный слух. Экспериментально-психологические исследования // Психол. журн. 2013. Т. 34. № 3. С. 45–62.
  8. Zupan B., Eskritt M. Facial and Vocal Emotion Recognition in Adolescence: A Systematic Review // Adolesc. Res. Rev. 2023. V. 1. P. 1–25. https://doi.org/10.1007/S40894-023-00219-7
  9. Charman T., Ricketts J., Dockrell J.E., Lindsay G., Palikara O. Emotional and behavioural problems in children with language impairments and children with autism spectrum disorders // Int. J. Lang. Commun. Disord. 2015. V. 50. № 1. P. 84–93. https://doi.org/10.1111/1460-6984.12116
  10. Lyakso E., Frolova O., Grigorev A., Gorodnyi V., Nikolaev A., Kurazhova A. Speech Features of 13–15 Year-Old Children with Autism Spectrum Disorders // Lect. Notes Comput. Sci. (including Subser Lect. Notes Artif. Intell. Lect. Notes Bioinformatics). 2020. V. 12335 LNAI. P. 291–303. https://doi.org/10.1007/978-3-030-60276-5_29
  11. Николаев А.С. Распознавание психоневрологического состояния детей с расстройствами аутистического спектра по речевым сигналам: акустические и перцептивные характеристики // Акуст. журн. 2024. Т. 70. № 3. С. 161–168. https://doi.org/10.31857/S0320791924030155
  12. Kleshnev E.A., Frolova O.V., Lyakso E.E. Peculiarities of the Emotions Manifestation in Speech and Facial Expressions by 7–8 Years Old Children // J. Evol. Biochem. Physiol. 2024. V. 60. № 2. P. 744–757.
  13. Ляксо Е.Е., Фролова О.В., Гречаный С.В., Матвеев Ю.Н., Верхоляк О.В., Карпов А.А. Голосовой портрет ребенка с типичным и атипичным развитием. Под ред. Ляксо Е.Е., Фроловой О.В. СПб.: Издательско-полиграфическая ассоциация высших учебных заведений, 2020. 284 с.
  14. Lyakso E., Frolova O., Dmitrieva E., Grigorev A., Kaya H., Salah A.A., Karpov A. EmoChildRu: Emotional Child Russian Speech Corpus // Lect. Notes Comput. Sci. 2015. V. 9319. P. 144–152.
  15. Matveev Y., Matveev A., Frolova O., Lyakso E., Ruban N. Automatic Speech Emotion Recognition of Younger School Age Children // Math. 2022. V. 10. № 14. P. 2373. https://doi.org/10.3390/MATH10142373
  16. Величко А.Н., Верхоляк О.В., Карпов А.А. Программная система для распознавания эмоций в речи (ProSpER — Program for Speech Emotion Recognition). М.: МАИ, 2020.
  17. Ляксо Е.Е., Ноздрачев А.Д., Соколова Л.В. Возрастная физиология и психофизиология: учебник и практикум для академического бакалавриата. М.: Издательство Юрайт, 2016. 352 с.
  18. Cruttenden A. Gimson's Pronunciation of English. London: Routledge, 2014. 7th ed. 368 p.
  19. Crone E.A., Dahl R.E. Understanding adolescence as a period of social-affective engagement and goal flexibility // Nat. Rev. Neurosci. 2012. V. 13. № 9. P. 636–650. https://doi.org/10.1038/NRN3313
  20. Bos D.J., Dreyfuss M., Tottenham N., Hare T.A., Galván A., Casey B.J., Jones R.M. Distinct and similar patterns of emotional development in adolescents and young adults // Dev. Psychobiol. 2020. V. 62. № 5. P. 591. https://doi.org/10.1002/DEV.21942
  21. Liu T.L., Wang P.W., Yang Y.H.C., Hsiao R.C., Su Y.Y., Shyi G.C.W., Yen C.F. Deficits in facial emotion recognition and implicit attitudes toward emotion among adolescents with high functioning autism spectrum disorder // Compr. Psychiatry. 2019. V. 90. P. 7–13. https://doi.org/10.1016/J.COMPPSYCH.2018.12.010
  22. Filippa M., Lima D., Grandjean A., Labbé C., Coll S.Y., Gentaz E., Grandjean D.M. Emotional prosody recognition enhances and progressively complexifies from childhood to adolescence // Sci. Rep. 2022. V. 12. № 1. P. 1–13. https://doi.org/10.1038/S41598-022-21554-0
  23. Lee C.Y., Chiang Y.C., Li A., Li X., Wu Y.T., Lin Y.J., Zhao Y., Zhang X. Influence of humor expression on suicidal ideation among adolescents: mediating effects of depressive emotion and positive emotion // BMC Psychiatry. 2020. V. 20.
  24. Chaplin T.M., Aldao A. Gender differences in emotion expression in children: A meta-analytic review // Psychol. Bull. 2013. V. 139. № 4. P. 735–765. https://doi.org/10.1037/A0030737
  25. Grigorev A.S., Gorodnyi V.A., Frolova O.V., Kondratenko A.M., Dolgaya V.D., Lyakso E.E. Acoustic and Perceptual Features of the Emotional Speech of Adolescents Aged 14–16 Years // Neurosci. Behav. Physi. 2020. V. 50. P. 1224–1231. https://doi.org/10.31857/S086981392003005X
  26. Organization WH ICD-10: international statistical classification of diseases and related health problems: tenth revision. Geneva: World Health Organization, 2004. 532 p.
  27. Kaiser A., Hester P., McDuffie A. Supporting communication in young children with developmental disabilities // Ment. Retard Dev. Disabil. Res. Rev. 2001. V. 7. № 2. P. 143–150. https://doi.org/10.1002/MRDD.1020
  28. Ypsilanti A., Grouios G. Linguistic profile of individuals with Down syndrome: comparing the linguistic performance of three developmental disorders // Child Neuropsychol. 2008. V. 14. № 2. P. 148–170. https://doi.org/10.1080/09297040701632209
  29. Pereira C.M.G., Faria S.M. de M. Do you Feel what I Feel? Emotional Development in Children with ID // Procedia Soc. Behav. Sci. 2015. V. 165. P. 52–61. https://doi.org/10.1016/J.SBSPRO.2014.12.604
  30. Frolova O., Nikolaev A., Grave P., Lyakso E. Speech Features of Children with Mild Intellectual Disabilities // ACM Int Conf Proceeding Ser. 2023. P. 406–413. https://doi.org/10.1145/3610661.3616236
  31. Long K.A., Lobato D., Kao B., Plante W., Grullón E., Cheas L., Houck C., Seifer R. Perceptions of Emotion Expression and Sibling–Parent Emotion Communication in Latino and Non-Latino White Siblings of Children With Intellectual Disabilities // J. Pediatr. Psychol. 2013. V. 38. № 5. P. 551. https://doi.org/10.1093/JPEPSY/JST01
  32. Lyakso E., Frolova O., Kleshnev E., Ruban N., Mary Mekala A., Arulalan K.V. Approbation of the Child’s Emotional Development Method (CEDM) // ACM Int. Conf. Proceeding Ser. 2022. P. 201–210. https://doi.org/10.1145/3536220.3563371
  33. Castro S.L., Lima C.F. Recognizing emotions in spoken language: a validated set of Portuguese sentences and pseudosentences for research on emotional prosody // Behav. Res. Methods. 2010. V. 42. № 1. P. 74–81. https://doi.org/10.3758/BRM.42.1.74
  34. Lyakso E., Ruban N., Frolova O., Mekala M.A. The children’s emotional speech recognition by adults: Cross-cultural study on Russian and Tamil language // PLoS One. 2023. V. 18. № 1. e0272837. https://doi.org/10.1371/JOURNAL.PONE.0272837
  35. Rashidah N., Juremi M.D., Zulkifley M.A., Hussain A., Diyana W.M., Zaki W. Inter-rater reliability of actual tagged emotion categories validation using Cohen’s Kappa coefficient // J. Theoretical and Applied Information Technology. 2017. V. 95. № 2. P. 31. http://www.jatit.org/volumes/Vol95No2/3Vol95No2.pdf
  36. Baurain C., Nader-Grosbois N., Dionne C. Socio-emotional regulation in children with intellectual disability and typically developing children, and teachers’ perceptions of their social adjustment // Res. Dev. Disabil. 2013. V. 34. № 8. P. 2774–2787. https://doi.org/10.1016/J.RIDD.2013.03.022
  37. te Brinke L.W., Schuiringa H.D., Matthys W. Emotion regulation and angry mood among adolescents with externalizing problems and intellectual disabilities // Res. Dev. Disabil. 2021. V. 109. № 103833. https://doi.org/10.1016/J.RIDD.2020.103833
  38. Lyakso E., Frolova O., Nikolaev A., Kleshnev E., Grave P., Ilyas A., Makhnytkina O., Nersisson R., Mary Mekala A., Varalakshmi M. Recognition of the Emotional State of Children by Video and Audio Modalities by Indian and Russian Experts // Lect. Notes Comput. Sci. (including Subser Lect. Notes Artif. Intell. Lect. Notes Bioinformatics). 2023. V. 14338. P. 469–482. https://doi.org/10.1007/978-3-031-48309-7_38

Supplementary files

Supplementary Files
Action
1. JATS XML
Download

Copyright (c) 2025 Russian Academy of Sciences