中国科学院深圳先进技术研究院机构知识库(SIAT OpenIR): Development and evaluation of a 3-D virtual pronunciation tutor for children with autism spectrum disorders
SIAT OpenIR  > 集成所
Development and evaluation of a 3-D virtual pronunciation tutor for children with autism spectrum disorders
Chen, Fei; Wang, Lan; Peng, Gang; Yan, Nan; Pan, Xiaojie
2019
Source PublicationPLOS ONE
Subtype期刊论文
AbstractThe deficit in speech sound production in some children with autism spectrum disorder (ASD) adds to their communication barriers. The 3-D virtual environments have been implemented to improve their communication abilities. However, there were no previous studies on the use of a 3-D virtual pronunciation tutor designed specifically to train pronunciation for children with ASD. To fill this research gap, the current study developed and evaluated a 3D virtual tutor which served as a multimodal and real-data-driven speech production tutor to present both places and manners of Mandarin articulation. Using an eye-tracking technique (RED 5 Eye Tracker), Experiment 1 objectively investigated children's gauged attention distribution online while learning with our computer-assisted 3-D virtual tutor in comparison to a real human face (HF) tutor. Eye-tracking results indicated most participants showed more interests in the visual speech cues of the 3-D tutor, and paid some degree of absolute attention to the additional visual speech information of both articulatory movements and airflow changes. To further compare treatment outcomes, training performance was evaluated in Experiment 2 with the ASD learners divided into two groups, with one group learning from the HF tutor and the other from the 3-D tutor (HF group vs. 3-D group). Both groups showed improvement with the help of computer-based training in the post-intervention test based on the calculation of a 5-point Likert scale. However, the 3-D group showed much higher gains in producing Mandarin stop and affricate consonants, and apical vowels. We conclude that our 3-D virtual imitation intervention system provides an effective approach of audiovisual pronunciation training for children with ASD.
Indexed BySCI
Language英语
EI Accession Number环绕智能
Document Type期刊论文
Identifierhttp://ir.siat.ac.cn/handle/172644/15319
Collection集成所
Recommended Citation
GB/T 7714
Chen, Fei,Wang, Lan,Peng, Gang,et al. Development and evaluation of a 3-D virtual pronunciation tutor for children with autism spectrum disorders[J]. PLOS ONE,2019.
APA Chen, Fei,Wang, Lan,Peng, Gang,Yan, Nan,&Pan, Xiaojie.(2019).Development and evaluation of a 3-D virtual pronunciation tutor for children with autism spectrum disorders.PLOS ONE.
MLA Chen, Fei,et al."Development and evaluation of a 3-D virtual pronunciation tutor for children with autism spectrum disorders".PLOS ONE (2019).
Files in This Item: Download All
File Name/Size DocType Version Access License
集成-环绕智能2019002.pdf(4390KB)期刊论文出版稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Chen, Fei]'s Articles
[Wang, Lan]'s Articles
[Peng, Gang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Chen, Fei]'s Articles
[Wang, Lan]'s Articles
[Peng, Gang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Chen, Fei]'s Articles
[Wang, Lan]'s Articles
[Peng, Gang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: 集成-环绕智能2019002.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.