Recognising and Expressing Emotions: Difficulties of Children with Autism Spectrum Disorder in Learning a Foreign Language and How to Resolve Them
Recognising emotions, facial expressions and tone of voice and body language, expressing and managing their own emotions, and understanding and responding to other people’s emotions are often difficult for children with autism spectrum disorder. Since the emotional codes of individuals with autism spectrum disorder are different, those people will possibly be awkward in expressing some throughout their lives. Although it might seem that children with autism spectrum disorder do not respond emotionally, the ability to understand their facial expressions could lead to an improvement in their social interaction difficulties. In addition, since autistic expressions might be unique to each child, recognising their emotions is important when delivering a personalised intervention to a child with autism spectrum disorder. In recent decades, researchers have become increasingly interested in the role of emotions in learning and teaching a foreign language beyond heavily investigated topics such as foreign language anxiety and motivation and attitudes towards the foreign language. In this paper, how emotions impact the motivation and success of children with autism spectrum disorder while they are learning a foreign language is presented. Challenges, opportunities and future research directions in this domain are given.
Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms & profiles. University of Vermont, Research Center for Children, Youth, and Families.
Alemi, M., Meghdari, A., & Ghazisaedy, M. (2014). Employing humanoid robots for teaching English language in Iranian junior high-schools. International Journal of Humanoid Robotics, 11(3), 1450022. https://doi.org/10.1142/S0219843614500224
Allely, C. S. (2013). Pain sensitivity and observer perception of pain in individuals with autistic spectrum disorder. The Scientific World Journal, 2013, 1–20. https://doi.org/10.1155/2013/916178
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders: DSM-5 (5th ed.). American Psychiatric Association.
Bagby, R. M., Parker, J. D. A., & Taylor, G. J. (1994). The twenty-item Toronto Alexithymia Scale—I. item selection and cross-validation of the factor structure. Journal of Psychosomatic Research, 38(1), 23–32. https://doi.org/10.1016/0022-3999(94)90005-1
Barcelos, A. M. F., & Aragão, R. C. (2018). Emotions in language teaching: A review of studies on teacher emotions in Brazil. Chinese Journal of Applied Linguistics, 41(4), 506–531. https://doi.org/10.1515/cjal-2018-0036
Baxter, P., Ashurst, E., Kennedy, J., Senft, E., Lemaignan, S., & Belpaeme, T. (2015). The wider supportive role of social robots in the classroom for teachers. Proceedings of 1st International Workshop on Educational Robotics at the International Conference on Social Robotics.
Berggren, S. (2017). Emotion recognition and expression in autism spectrum disorder: Significance, complexity, and effect of training (Doctoral dissertation, Karolinska Institutet, Stockholm, Sweden). https://openarchive.ki.se/xmlui/bitstream/handle/10616/45900/Thesis_Steve_Berggren.pdf
Bishop‐Fitzpatrick, L., Mazefsky, C. A., Minshew, N. J., & Eack, S. M. (2015). The relationship between stress and social functioning in adults with autism spectrum disorder and without intellectual disability. Autism Research, 8(2), 164–173. https://doi.org/10.1002/aur.1433
Bown, J., & White, C. J. (2010) Affect in a self-regulatory framework for language learning. System, 38(3), 432–443.
Breazeal, C. (2003). Toward sociable robots. Robotics and Autonomous Systems, 42(3-4), 167–175. https://doi.org/10.1016/S0921-8890(02)00373-1
Brian, J. A., Zwaigenbaum, L., & Ip, A. (2019). Standards of diagnostic assessment for autism spectrum disorder. Paediatrics & Child Health, 24(7), 444–460. https://doi.org/10.1093/pch/pxz117
Bridgemohan, C., Cochran, D. M., Howe, Y. J., Pawlowski, K., Zimmerman, A. W., Anderson, G. M., Choueiri, R., Sices, L., Miller, K. J., Ultmann, M., Helt, J., Forbes, P. W., Farfel, L., Brewster, S. J., Frazier, J. A., & Neumeyer, A. M. (2019). Investigating potential biomarkers in autism spectrum disorder. Frontiers in Integrative Neuroscience, 13, 31. https://doi.org/10.3389/fnint.2019.00031
Bruner, J. S. (1974). From communication to language: A psychological perspective. Cognition, 3(3), 255–287. https://doi.org/10.1016/0010-0277(74)90012-2
Campbell, D. B., Buie, T. M., Winter, H., Bauman, M., Sutcliffe, J. S., Perrin, J. M., & Levitt, P. (2009). Distinct genetic risk based on association of MET in families with co-occurring autism and gastrointestinal conditions. Pediatrics, 123(3), 1018–1024. https://doi.org/10.1542/peds.2008-0819
Chang, C. -W., Lee, J. -H., Chao, P. -Y., Wang, C. -Y., & Chen, G. -D. (2010). Exploring the possibility of using humanoid robots as instructional tools for teaching a second language in primary school. Educational Technology & Society, 13(2), 13–24.
Chen, G. D., & Chang, C. W. (2008). Using humanoid robots as instructional media in elementary language education. Proceedings of Second IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning (IEEE), 201–202. https://doi.org/10.1109/DIGITEL.2008.17
Clark, T. F., Winkielman, P., & McIntosh, D. N. (2008). Autism and the extraction of emotion from briefly presented facial expressions: stumbling at the first step of empathy. Emotion, 8(6), 803–809. https://doi.org/10.1037/a0014124
Constantino, J. N., & Gruber, C. P. (2012). Social responsiveness scale (2nd ed.) (SRS-2). Western Psychological Services.
Costa, A. P., Steffgen, G., Rodriguez Lera, F. J., Nazarikhorram, A., & Ziafati, P. (2017). Socially assistive robots for teaching emotional abilities to children with autism spectrum disorder. Proceedings of 3rd Workshop on Child-Robot Interaction at HRI 2017, 06. 03. 2017-09.03.2017, Vienna, Austria.
Costa, A. P., Kirsten, L., Charpiot, L., & Steffgen, G. (2019). Mental health benefits of a robot-mediated emotional ability training for children with autism: An exploratory study. Annual Meeting of the International Society for Autism Research (INSAR 2019).
Crais, E. R., & Watson, L. R. (2014). Challenges and opportunities in early identification and intervention for children at-risk for autism spectrum disorders. International Journal of Speech-Language Pathology, 16(1), 23–29. https://doi.org/10.3109/17549507.2013.862860
Crombie, M., & McColl, H. (2001). Dyslexia and the teaching of modern foreign languages. In L. Peer, & G. Reid, (Eds.), Dyslexia - successful inclusion in the secondary school (pp. 211–217). David Fulton.
Crompton, H., Gregory, K., & Burke, D. (2018). Humanoid robots supporting children’s learning in an early childhood setting. British Journal of Educational Technology, 49(5), 911–927. https://doi.org/10.1111/bjet.12654
Dawson, G., Bernier, R., & Ring, R. H. (2012). Social attention: A possible early indicator of efficacy in autism clinical trials. Journal of Neurodevelopmental Disorders, 4(1), 11. https://doi.org/10.1186/1866-1955-4-11
Dewaele, J. M., Chen, X., Padilla, A. M., & Lake, J. (2019). The Flowering of Positive Psychology in Foreign Language Teaching and Acquisition Research. Frontiers in Psychology, 10, 2128. https://doi.org/10.3389/fpsyg.2019.02128
Dunn, M., & Ernst-Slavit, G. (2018). Emotional challenges faced by L2 teachers when teaching and assessing students with learning disabilities and difficulties. In J. Martínez Agudo (Ed.), Emotions in second language teaching (pp. 223–241). Springer. https://doi.org/10.1007/978-3-319-75438-3_13
Ekman, P. (2003). Emotions revealed. Owl Books.
Esteban, P. G., Baxter, P. E., Belpaeme, T., Billing, E. A., Cai, H., Cao, H., Coeckelbergh, M., Costescu, C. A., David, D. O., Beir, A. D., Fang, Y., Ju, Z., Kennedy, J., Liu, H., Mazel, A., Pandey, A. K., Richardson, K., Senft, E., Thill, S., Perre, G. V., Vanderborght, B., Vernon, D., Yu, H., & Ziemke, T. (2017). How to build a supervised autonomous system for robot-enhanced therapy for children with autism spectrum disorder. Paladyn Journal of Behavioral Robotics, 8(1), 18–38. https://doi.org/10.1515/pjbr-2017-0002
Frith, U., & Frith, C. D. (2003). Development and neurophysiology of mentalizing. Philosophical Transactions of the Royal Society B: Biological Sciences, 358(1431), 459–473. https://doi.org/10.1098/rstb.2002.1218
Goodman, R. (1997). The strengths and difficulties questionnaire: A research note. Child Psychology & Psychiatry & Allied Disciplines, 38(5), 581–586. https://doi.org/10.1111/j.1469-7610.1997.tb01545.x
Garret, P., & Young, R. F. (2009). Theorizing affect in foreign language learning: an analysis of one learner’s responses to a communicative Portuguese course. The Modern Language Journal, 93(2), 209–226.
Ginsberg, Y., Beusterien, K. M., Amos, K., Jousselin, C., & Asherson, P. (2014). The unmet needs of all adults with ADHD are not the same: a focus on Europe. Expert Review of Neurotherapeutics, 14(7), 799–812. https://doi.org/10.1586/14737175.2014.926220
Gray, C. (1994). Comic strip conversations: Illustrated interactions with students with autism and related disorders. Future Horizons.
Gross, J. J., & John, O. P. (2003). Individual differences in two emotion regulation processes: Implications for affect, relationships, and well-being. Journal of Personality and Social Psychology, 85(2), 348–362. https://doi.org/10.1037/0022-35188.8.131.528
Guthrie, W., Swineford, L., Nottke, C., & Wetherby, A. (2013). Early diagnosis of autism spectrum disorder: Stability and change in clinical diagnosis and symptom presentation. Journal of Child Psychology and Psychiatry, 54(5), 582–590. https://doi.org/10.1111/jcpp.12008
Henricsson, L., & Rydell, A. M. (2006). Children with behaviour problems: The influence of social competence and social relations on problem stability, school achievement and peer acceptance across the first six years of school. Infant and Child Development, 15(4), 347–366. https://doi.org/10.1002/icd.448
Howlin, P., Goode, S., Hutton, J., & Rutter, M. (2004). Adult outcome for children with autism. Journal of Child Psychology and Psychiatry, 45(2), 212–229. https://doi.org/10.1111/j.1469-7610.2004.00215.x
Huerta, M., & Lord, C. (2012). Diagnostic evaluation of autism spectrum disorders. Pediatric Clinics of North America, 59(1), 103–xi. https://doi.org/10.1016/j.pcl.2011.10.018
Hung, I.-C., Chao, K.-J., Lee, L., & Chen, N.-S. (2013). Designing a robot teaching assistant for enhancing and sustaining learning motivation. Interactive Learning Environments, 21(2), 156–171. https://doi.org/10.1080/10494820.2012.705855
Imai, Y. (2010). Emotions in SLA: New insights from collaborative learning for an EFL classroom. The Modern Language Journal, 94(2), 278–292.
Immordino-Yang, M. H., & Damasio, A. (2007). We feel, therefore we learn: The relevance of affective and social neuroscience to education. Mind, Brain and Education, 1(1), 3–10.
Isaksson, J., Van’t Westeinde, A., Cauvet, É., Kuja-Halkola, R., Lundin, K., Neufeld, J., Willfors, C., & Bölte, S. (2019). Social cognition in autism and other neurodevelopmental disorders: A co-twin control study. Journal of autism and developmental disorders, 49(7), 2838–2848. https://doi.org/10.1007/s10803-019-04001-4
Karimi, M., & Chalak, A. (2017). Compensation for lack of flexibility among autistic foreign language learners by applying visual prompts and input enhancement: the case of reaction time. Proceedings of International Conference ICT for Language Learning, 10th Conference Edition, Florence, Italy, November 9–10, 2017.
Kubanyiova, M., & Feryok, A. (2015). Language teacher cognition in applied linguistics research: Revisiting the territory, redrawing the boundaries, reclaiming the relevance. Modern Language Journal, 99(3), 435–449. https://doi.org/10.1111/modl.12239
Kuusikko, S., Haapsamo, H., Jansson-Verkasalo, E., Hurtig, T., Mattila, M. L., Ebeling, H., Jussila, K., Bölte, S., & Moilanen, I. (2009). Emotion recognition in children and adolescents with autism spectrum disorders. Journal of Autism and Developmental Disorders, 39(6), 938–945. https://doi.org/10.1007/s10803-009-0700-0
Lecciso, F., Levante, A., Fabio, R. A., Caprì, T., Leo, M., Carcagnì, P., Distante, C., Mazzeo, P. L., Spagnolo, P., & Petrocchi, S. (2021). Emotional expression in children with ASD: A pre-study on a two-group pre-post-test design comparing robot-based and computer-based training. Frontiers in psychology, 12, 678052. https://doi.org/10.3389/fpsyg.2021.678052
Lockwood Estrin, G., Milner, V., Spain, D., Happé, F., & Colvert, E. (2021). Barriers to autism spectrum disorder diagnosis for young women and girls: A Systematic Review. Review Journal of Autism and Developmental Disorders, 8(4), 454–470. https://doi.org/10.1007/s40489-020-00225-8
Lord, C., Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop, S. (2012). Autism diagnostic observation schedule (2nd ed.). Western Psychological Services.
Meghdari, A., Alemi, M., Ghaazisaidi, M., Tahen, A. R., Karimian, A., & Vakih, M. Z. (2013). Applying robots as teaching assistant in EFL classes in Iranian middle schools. Proceedings of the 2013 International Conference on Education and Modern Educational Technologies (pp.68–73).
Méndez López, M. G. (2011). The motivational properties of emotions in foreign language learning. Colombian Applied Linguistics Journal, 13(2), 43–58. http://www.scielo.org.co/scielo.php?script=sci_arttext&pid=S0123-46412011000200004&lng=en&tlng=en
Méndez López, M. G, & Peña Aguilar, A. (2013). Emotions as learning enhancers of foreign language learning motivation. Profile Issues in Teachers’ Professional Development, 15(1), 109–124.
Mubin, O., Stevens, C. J., Shahid, S., Al Mahmud, A., & Dong, J. J. (2013). A review of the applicability of robots in education. Technology for Education and Learning, 1(1), 13. https://doi.org/10.2316/Journal.209.2013.1.209-0015
Newton, D. P. (2014). Thinking with feeling. Routledge.
Newton, D. P., & Newton, L. D. (2019). Humanoid robots as teachers and a proposed code of practice. Frontiers in Education, 4, 125. https://doi.org/10.3389/feduc.2019.00125
Pandey, A. K., & Gelin, R. (2017). Humanoid robots in education. In A. Goswami & P. Vadakkepat (Eds.), Humanoid robotics: A reference (pp. 1–16). Springer. https://doi.org/10.1007/978-94-007-7194-9_113-1
Pekrun, R. (2000). A social-cognitive, control-value theory of achievement emotions. Elsevier Science B.V.
Rahman, R., Kodesh, A., Levine, S. Z., Sandin, S., Reichenberg, A., & Schlessinger, A. (2020). Identification of newborns at risk for autism using electronic medical records and machine learning. European Psychiatry, 63(1), e22. https://doi.org/10.1192/j.eurpsy.2020.17
Randall, M., Egberts, K. J., Samtani, A., Scholten, R. J. P. M., Hooft, L., Livingstone, N., Sterling‐Levis, K., Woolfenden, S., & Williams, K. (2018). Diagnostic tests for autism spectrum disorder (ASD) in preschool children. Cochrane Database of Systematic Reviews, 2018(7), Art. No.: CD009044. https://doi.org/10.1002/14651858.CD009044.pub2
Reichow, B., Steiner, A. M., & Volkmar, F. (2013). Cochrane review: social skills groups for people aged 6 to 21 with autism spectrum disorders (ASD). Evidence‐Based Child Health: A Cochrane Review Journal, 8(2), 266–315. https://doi.org/10.1002/ebch.1903.
Robinson, A. (2018). Emotion-focused therapy for autism spectrum disorder: A case conceptualization model for trauma-related experiences. Journal of Contemporary Psychotherapy, 48, 133–143. https://doi.org/10.1007/s10879-018-9383-1
Rump, K. M., Giovannelli, J. L., Minshew, N. J., & Strauss, M. S. (2009). The development of emotion recognition in individuals with autism. Child development, 80(5), 1434–1447. https://doi.org/10.1111/j.1467-8624.2009.01343.x
Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78.
Schopler, E., Van Bourgondien, M. E., Wellman, G. J., & Love, S. R. (2010). The childhood autism rating scale, second edition. Western Psychological Services.
Segrin, C., & Flora, J. (2000). Poor social skills are a vulnerability factor in the development of psychosocial problems. Human Communication Research, 26(3), 489–514. https://doi.org/10.1111/j.1468-2958.2000.tb00766.x
Shields, A. M., & Cicchetti, D. (1997). Emotion regulation among school-age children: The development and validation of a new criterion Q-sort scale. Developmental Psychology, 33(6), 906–916.
SoftBank Robotics & ERM. (2021). SNAO, a humanoid robot as a therapeutic mediator for young people with autism [White paper]. SoftBank Robotics.
Spirina, A. V., Semenkin, E. S., Schmitt, A., & Minker, W. (2015). Interaction quality in human-human conversations: Problems and possible solutions. Journal of Siberian Federal University. Mathematics & Physics, 8(2), 217–223. https://doi.org/10.17516/1997-1397-2015-8-2-217-223
Steinbrenner, J. R., Hume, K., Odom, S. L., Morin, K. L., Nowell, S. W., Tomaszewski, B., Szendrey, S., McIntyre, N. S., Yücesoy-Özkan, S., & Savage, M. N. (2020). Evidence-based practices for children, youth, and young adults with autism. The University of North Carolina at Chapel Hill, Frank Porter Graham Child Development Institute, National Clearinghouse on Autism Evidence and Practice Review Team.
Tanaka, F., & Matsuzoe, S. (2012). Learning verbs by teaching a care-receiving robot by children: An experimental report. In Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction (pp. 253–254). ACM.
Taylor, J. L., & Seltzer, M. M. (2011). Employment and post-secondary educational activities for young adults with autism spectrum disorders during the transition to adulthood. Journal of Autism and Developmental Disorders, 41(5), 566–574. https://doi.org/10.1007/s10803-010-1070-3
Tissot, C., & Evans, R. (2003). Visual teaching strategies for children with autism. Early Child Development and Care, 173(4), 425–433. https://doi.org/10.1080/0300443032000079104
Toh, L. P. E., Causo, A., Tzuo, P.-W., Chen, I-M., & Yeo, S. H. (2016). A review on the use of robots in education and young children. Journal of Educational Technology & Society, 19(2), 148–163.
Trembath, D., Vivanti, G., Iacono, T., & Dissanayake, C. (2015). Accurate or assumed: Visual learning in children with ASD. Journal of Autism and Developmental Disorders, 45(10), 3276–3287. doi:10.1007/s10803-015-2488-4
Tuna, A., & Tuna, G. (2019). The use of humanoid robots with multilingual interaction skills in teaching a foreign language: Opportunities, research challenges and future research directions. Center for Educational Policy Studies Journal, 9(3), 95–115. https://doi.org/10.26529/cepsj.679
Vadnjal, J., & Radoja, D. (2020). Business school teachers’ experiences with a student with autism spectrum disorder. Center for Educational Policy Studies Journal, 10(1), 167–189. https://doi.org/10.26529/cepsj.270
van den Berghe, R., Verhagen, J., Oudgenoeg-Paz, O., van der Ven, S., & Leseman, P. (2019). (2019). Social robots for language learning. Review of Educational Research, 89(2), 259–295. https://doi.org/10.3102/0034654318821286
van Karnebeek, C. D. M., & Stockler-Ipsiroglu, S. (2014). Early identification of treatable inborn errors of metabolism in children with intellectual disability: The Treatable Intellectual Disability Endeavor Protocol in British Columbia. Paediatrics & Child Health, 19(9), 469–471. https://doi.org/10.1093/pch/19.9.469
Vogt, P., van den Berghe, R., de Haas, M., Hoffman, L., Kanero, J., Mamus, E., et al. (2019). Second language tutoring using social robots, In 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI) (pp. 253–254).
Wehman, P. H., Schall, C. M., McDonough, J., Kregel, J., Brooke, V., Molinelli, A., Ham, W., Graham, C. W., Erin Riehle, J., Collins, H. T., & Thiss, W. (2014). Competitive employment for youth with autism spectrum disorders: Early results from a randomized clinical trial. Journal of Autism and Developmental Disorders, 44(3), 487–500. https://doi.org/10.1007/s10803-013-1892-x
Weiner, B. (1992). Human motivation: Metaphors, theories and research. Sage.
Wechsler, D. & Naglieri, J. A. (2006). Wechsler nonverbal scale of ability. Pearson.
White, S. W., Keonig, K., & Scahill, L. (2007). Social skills development in children with autism spectrum disorders: A review of the intervention research. Journal of Autism and Developmental Disorders, 37(10), 1858–1868. https://doi.org/10.1007/s10803-006-0320-x
White, S. W., Ollendick, T. H., & Bray, B. C. (2011). College students on the autism spectrum: Prevalence and associated problems. Autism, 15(6), 683–701. https://doi.org/10.1177/1362361310393363
Wing, L., Leekam, S. R., Libby, S. J., Gould, J., & Larcombe, M. (2002). The Diagnostic Interview for Social and Communication Disorders: Background, inter-rater reliability and clinical use. Journal of child psychology and psychiatry, and allied disciplines, 43(3), 307–325. https://doi.org/10.1111/1469-7610.000237-325
Wingfield, B., Miller, S., Yogarajah, P., Kerr, D., Gardiner, B., Seneviratne, S., Samarasinghe, P., & Coleman, S. (2020). A predictive model for paediatric autism screening. Health Informatics Journal, 26(4), 2538–2553. https://doi.org/10.1177/1460458219887823
Wire, V. (2005). Autistic spectrum disorders and learning foreign languages. Support for Learning, 20(3), 123–128.
Wood, J. J., Drahota, A., Sze, K., Har, K., Chiu, A., & Langer, & D. A. (2009). Cognitive behavioral therapy for anxiety in children with autism spectrum disorders: A randomized, controlled trial. Journal of child psychology and psychiatry, and allied disciplines, 50(3), 224–234. https://doi.org/10.1111/j.1469-7610.2008.01948.x
Zheng, Z., Das, S., Young, E., Swanson, A., Warren, Z., & Sarkar, N. (2014). Autonomous robot-mediated imitation learning for children with autism. In Proceedings of IEEE International Conference on Robotics and Automation (pp. 2707–2712). https://doi.org/10.1109/ICRA.2014.6907247
Zwaigenbaum, L., Bauman, M. L., Choueiri, R., Kasari, C., Carter, A., Granpeesheh, D., Mailloux, Z., Smith Roley, S., Wagner, S., Fein, D., Pierce, K., Buie, T., Davis, P. A., Newschaffer, C., Robins, D., Wetherby, A., Stone, W. L., Yirmiya, N., Estes, A., Hansen, R. L., McPartland, J. C., & Natowicz, M. R. (2015). Early intervention for children with autism spectrum disorder under 3 years of age: Recommendations for practice and research. Pediatrics, 136(Suppl 1), S60–81. https://doi.org/10.1542/peds.2014-3667E
In order to ensure both the widest dissemination and protection of material published in CEPS Journal, we ask Authors to transfer to the Publisher (Faculty of Education, University of Ljubljana) the rights of copyright in the Articles they contribute. This enables the Publisher to ensure protection against infringement.