双耳双模式干预者言语情感识别研究

Study on Voice Emotion Recognition of Mandarin-speaking Bimodal Listeners

夏雨奇;魏朝刚;刘玉和

1:北京大学第一医院耳鼻咽喉头颈外科

2:首都医科大学附属北京友谊医院耳鼻咽喉头颈外科

摘要
目的 研究双耳双模式干预者言语情感识别能力及特点,为单侧人工耳蜗植入(CI)者的听觉言语康复提供参考。方法 招募17例双模式干预语后聋成人参与研究,20例正常听力成人及18例单侧CI语后聋成人作为对照组,采用自编的情感识别测试软件对三组言语情感识别能力进行测试。结果 (1)相较于正常听力者,双模式干预者和单侧CI者情感识别的正确率降低,反应时间延长(P<0.05);(2)双模式干预者和单侧CI者情感识别率无显著差异(P>0.05),但双模式干预者的反应时间比单侧CI者缩短(P<0.05);(3)双模式干预者在女声材料中的反应时间比男声材料显著快0.14 s。双模式干预者对中性情感的识别率最高,为96.67%;对恐惧情感的识别率最低,为41.82%。结论 相较于正常听力者,汉语双模式干预者的言语情感识别能力仍有明显缺陷,但比单侧CI者更好。汉语CI者非植入耳配戴HA可以改善情感识别能力。
关键词
双模式;人工耳蜗植入;助听器;言语情感
基金项目(Foundation):
北京市科委科技计划首都临床诊疗技术研究及示范应用专项(Z191100006619027);; 国家自然科学基金面上项目(82071070);; 首都卫生发展科研专项(2022-1-2023)
作者
夏雨奇;魏朝刚;刘玉和
参考文献

1 Morningstar M,Nelson EE,Dirks MA.Maturation of vocal emotion recognition:insights from the developmental and neuroimaging literature[J].Neuroscience & Biobehavioral Reviews,2018,90:221-230.

2 Picou EM,Singh G,Goy H,et al.Hearing,emotion,amplification,research,and training workshop:current understanding of hearing loss and emotion perception and priorities for future research[J].Trends Hear,2018,22.DOI:10.1177/2331216518803215.

3 Ekberg M,Andin J,Stenfelt S,et al.Effects of mild-to-moderate sensorineural hearing loss and signal amplification on vocal emotion recognition in middle-aged-older individuals[J].PLoS One,2022,17(1):e0261354.DOI:10.1371/journal.pone.0261354.

4 Ren L,Zhang Y,Zhang J,et al.Voice emotion recognition by mandarin-speaking children with cochlear implants[J].Ear Hear,2022,43(1):165-180.

5 Lin YS,Wu CM,Limb CJ,et al.Voice emotion recognition by mandarin-speaking pediatric cochlear implant users in taiwan[J].Laryngoscope Investig Otolaryngol,2022,7(1):250-258.

6 Ching TY,van Wanrooy E,Dillon H.Binaural-bimodal fitting or bilateral implantation for managing severe to profound deafness:a review[J].Trends Amplif,2007,11(3):161-192.

7 彭惠融,申丽君,银力,等.双模式人工耳蜗植入者临床疗效Meta分析[J].听力学及言语疾病杂志,2023,31(4):360-365.

8 Most T,Gaon-Sivan G,Shpak T,et al.Contribution of a contralateral hearing aid to perception of consonant voicing,intonation,and emotional state in adult cochlear implantees[J].J Deaf Stud Deaf Educ,2012,17(2):244-258.

9 Shirvani S,Jafari Z,Motasaddi Zarandi M,et al.Emotional perception of music in children with bimodal fitting and unilateral cochlear implant[J].Ann Otol Rhinol Laryngol,2016,125(6):470-477.

10 Zhang T,Dorman MF,Fu QJ,et al.Auditory training in patients with unilateral cochlear implant and contralateral acoustic stimulation[J].Ear Hear,2012,33(6):e70-79.

11 陶仁霞,赵航,刘巧云.双耳双模式助听儿童情感语调感知特征[J].中国听力语言康复科学杂志,2021,19(2):133-136.

12 刘玉和,任蕾,魏朝刚,等.汉语普通话的言语情感识别能力测试评估系统[P].CN202010240739.5.2022-12-02.

13 Pak CL,Katz WF.Recognition of emotional prosody by mandarin-speaking adults with cochlear implants[J].J Acoust Soc Am,2019,146(2).DOI:10.1121/1.5122192

14 Balkenhol T,Wallhausser-Franke E,Rotter N,et al.Cochlear implant and hearing aid:objective measures of binaural benefit[J].Front Neurosci,2020,14:586119.DOI:10.3389/fnins.2020.586119.

15 Smiljanic R,Sladen D.Acoustic and semantic enhancements for children with cochlear implants[J].J Speech Lang Hear Res,2013,56(4):1085-1096.

16 Yoon YS,Li Y,Fu QJ.Speech recognition and acoustic features in combined electric and acoustic stimulation[J].J Speech Lang Hear Res,2012,55(1):105-124.

17 Bartov T,Most T.Song recognition by young children with cochlear implants:comparison between unilateral,bilateral,and bimodal users[J].J Speech Lang Hear Res,2014,57(5):1929-1941.

18 Houben R,van Doorn-Bierman M,Dreschler WA.Using response time to speech as a measure for listening effort[J].Int J Audiol,2013,52(11):753-761.

19 Chang YP,Chang RY,Lin CY,et al.Mandarin tone and vowel recognition in cochlear implant users:effects of talker variability and bimodal hearing[J].Ear Hear,2016,37(3):271-281.

20 Chatterjee M,Zion DJ,Deroche ML,et al.Voice emotion recognition by cochlear-implanted children and their normally-hearing peers[J].Hear Res,2015,322:151-162.

21 Sultana S,Rahman MS,Selim MR,et al.Sust bangla emotional speech corpus (subesco):an audio-only emotional speech corpus for bangla[J].PLoS One,2021,16(4):DOI:10.1371/journal.pone.0250173.

本文信息

PDF(161K)

本文作者相关文章

夏雨奇魏朝刚刘玉和