Identifying Reading Fluency in Pupils with and without Dyslexia Using a Machine Learning Model on Texts Assessed with a Readability Application
Abstract
Measurement of readability is an important tool for assessing reading disorders such as dyslexia. Among the screening procedures for dyslexia is the reading fluency test, which is defined as the ability to read with speed, accuracy and proper expression. The reading fluency test often consists of a sequence of unrelated written texts ranging from simple short sentences to more difficult and longer paragraphs. In psychological testing instruments, subjective text assessment is often replaced by objective readability formulas, e.g., the Automated Readability Index. Readability formulas extract multiple features from a given text and output a score indicating the difficulty of the text. The aim of the present study is to build a machine learning model that discriminates between pupils identified with dyslexia and a control group without dyslexia based on fluency in oral reading of texts assessed with a readability application developed within the project For the Quality of Slovenian Textbooks. We focus on differentiation between both groups of pupils by analysing data obtained from transcriptions of audio recordings of oral reading. The empirical study was conducted with 27 pupils aged 8 and 9 with officially diagnosed dyslexia and a control group without identified dyslexia.
Downloads
References
Anderson, N. J. (1999). Exploring second language reading: Issues and strategies. Heinle & Heinle.
Audacity® software is copyright © 1999-2021 Audacity Team. The name Audacity® is a registered trademark.
Bailey, E. (2020). Tips for teaching vocabulary to students with dyslexia. ThoughtCo. thoughtco.com/teaching-vocabulary-to-students-with-dyslexia-3111207
Boardman, A. G., Roberts, G., Vaughn, S., Wexler, J., Murray, C. S., & Kosanovich, M. (2008). Effective instruction for adolescent struggling readers: A practice brief. RMC Research Corporation, Center of Instruction.
Carioti, D., Masia, M. F., Travellini, S., & Berlingeri, M. (2021). Orthographic depth and developmental dyslexia: A meta-analytic study. Annals of Dyslexia, 71(3), 399–438. https://doi.org/10.1007/s11881-021-00226-0
Carpentieri, J. D. (2012). Act now: The EU high level group of experts report on literacy. https://discovery.ucl.ac.uk/id/eprint/10061875/1/HLGL-final-report_en.pdf
Demsar, J., Curk, T., Erjavec, A., Gorup, C., Hocevar, T., Milutinovic, M., Mozina, M., Polajnar, M., Toplak, M., Staric, A., Stajdohar, M., Umek, L., Zagar, L., Zbontar, J., Zitnik, M., & Zupan, B. (2013). Orange: Data Mining Toolbox in Python. Journal of Machine Learning Research 14(1), 2349−2353.
Demšar, J., Leban, G., & Zupan, B. (2007). FreeViz—An intelligent multivariate visualization approach to explorative analysis of biomedical data. Journal of Biomedical Informatics, 40(6), 661–671.
Drigas, A. S., & Politi-Georgousi, S. (2019). ICTs as a distinct detection approach for dyslexia screening: A contemporary view. International Journal of Online and Biomedical Engineering, 15(13), 46–60. https://doi.org/10.3991/ijoe.v15i13.11011
Elley, W. B., GradiÅ¡ar, A., & Lapajne, Z. (1995). Kako berejo uÄenci po svetu in pri nas [How pupils read in Slovenia and abroad]. Education, 3.
Erbeli, F., & Pizorn, K. (2012). Reading ability, reading fluency and orthographic skills: The case of L1 Slovene English as a foreign language students. CEPS Journal, 2(3), 119–139.
Fletcher, J., Lyon, G., Fuchs, L., & Barnes, M. (2007). Learning disabilities: From identification to intervention. The Guilford Press.
González, G. F., Žarić, G., Tijms, J., Bonte, M., Blomert, L., & van der Molen, M. W. (2015). A randomized controlled trial on the beneficial effects of training letter-speech sound integration on reading fluency in children with dyslexia. PLoS ONE, 10(12), Article e.0143914.
GradiÅ¡ar, A., & PeÄjak, S. (1991). Enominutni test glasnega branja [The One-Minute Test of Reading Aloud].
Hulme, C., & Snowling, M. J. (2009). Developmental disorders of language, learning and cognition. Wiley-Blackwell.
Hulme, C., & Snowling, M. J. (2016). Reading disorders and dyslexia. Current Opinion in Pediatrics, 28(6), 731.
IDA (2002). Definition of dyslexia. International Dyslexia Association, Board of Directors: 12 November 2002. http://eida.org/definition-of-dyslexia/
Kairaluoma, L., Ahonen, T., Aro, M., & Holopainen, L. (2007). Boosting reading fluency: An intervention case study at subword level, Scandinavian Journal of Educational Research, 51(3), 253–274. https://doi.org/10.1080/00313830701356117
Klingner, J. K., Vaughn, S., & Boardman, A. (2007). Teaching reading comprehension to students with learning difficulties. The Guilford Press.
Kononenko, I. (1994). Estimating attributes: Analysis and extensions of Relief. In L. De Raedt and F. Bergadano (Eds.), Machine learning: ECML-94 (pp. 171–182). Springer Verlag.
KoÅ¡ir, J. (2011). Formativno ocenjevanje s preizkusom tekoÄnosti branja, ki temelji na kurikulu [Formative assessment with a curriculum-based test of reading fluency]. In L. Magajna & M. Velikonja (Eds.), UÄenci z uÄnimi težavami: Prepoznavanje in diagnostiÄno ocenjevanje (pp. 105–123). Univerza v Ljubljani, PedagoÅ¡ka fakulteta.
Magajna, L. (1994). Razvoj bralnih strategij – vloga kognitivnega in fonološkega razvoja ter fonološke strukture jezika [Development of reading strategies: The role of cognitive and phonological development and the phonological structure of language]. Doctoral dissertation. Univerza v Ljubljani, Filozofska fakulteta.
Magajna, L., Kavkler, M., KoÅ¡ak Babuder, M., ZupanÄiÄ Danko, A., SerÅ¡en Fras, A., & RoÅ¡er Obretan, A. (2015). Otroci s primanjkljaji na posameznih podroÄjih uÄenja. [Children with deficits in individual areas of learning]. In N. Vovk Ornik (Eds.), Kriteriji za opredelitev vrste in stopnje primanjkljajev, ovir oz. motenj otrok s posebnimi potrebami [Criteria for defining the type and degree of deficits, obstacles and disorders of children with special needs] (pp. 23−31). Zavod RS za Å¡olstvo.
MartÃnez-GarcÃa, C., Suárez-Coalla, P., & Cuetos, F. (2019). Development of orthographic representations in Spanish children with dyslexia: The influence of previous semantic and phonological knowledge. Annals of Dyslexia, 69, 186–203. https://doi.org/10.1007/s11881-019-00178-6
Mather, N., & Wendling, J. B. (2012). Essentials of dyslexia assessment and intervention. John Wiley & Sons.
Menghini, D., Finzi, A., Carlesimo, G. A., & Vicari, S. (2011). Working memory impairment in children with developmental dyslexia: Is it just a phonological deficity? Developmental Neuropsychology, 36(2), 199–213.
Moats, L. C., & Dakin, K. E. (2008). Basic facts about dyslexia and other reading problems. The International Dyslexia Association.
Nation, K. (2006). Assessing children’s reading comprehension. In M. J. Snowling and J. Stackhouse (Eds.), Dyslexia, speech and language: A practitioner’s handbook (pp. 128–142). Whurr publishers.
Nicolson, R. I., & Fawcett, A. J. (1990). Automaticity: A new framework for dyslexia research? Cognition, 35(2), 159–182. https://doi.org/10.1016/0010-0277(90)90013-A
Nicolson, R. I., & Fawcett, A. J. (2007). Procedural learning difficulties: Reuniting the developmental disorders? Trends in neurosciences, 30(4), 135–141. https://doi.org/10.1016/j.tins.2007.02.003
Nijakowska, J. (2016). Grasping dyslexia: Bridging the gap between research and practice. Selected Papers on Theoretical and Applied Linguistics, 21, 43–58.
PeÄjak, S., Magajna, L., & PotoÄnik, N. (2012a). Ocenjevalna shema bralnih zmožnosti uÄencev 1.–3. razreda: OSBZ [An evaluation scheme for pupils’ reading abilities in grades 1–3]. Znanstvena založba Filozofske fakultete, Univerze v Ljubljani.
PeÄjak, S., Magajna, L., PotoÄnik, N., & Podlesek, A. (2012b). Bralni test [The reading test]. Znanstvena založba Filozofske fakultete, Univerze v Ljubljani.
Perera, H., Shiratuddin, M. F., & Wong, K. W. (2016). Review of the role of modern computational technologies in the detection of dyslexia. In Information Science and Applications (ICISA) 2016 (pp. 1465–1475). Springer. https://doi.org/10.1007/978-981-10-0557-2_141
Pollak, D. (Ed.). (2009). Neurodiversity in higher education: Positive responses to specific learning differences. John Wiley & Sons.
PoznanoviÄ, M., Cestnik, M., ÄŒuden, M., Gomivnik Thuma, V., Honzak, M., Križaj, M., Rosc-Leskovec, D., ŽvegliÄ, M., & AhaÄiÄ, K. (2018). UÄni naÄrt. Program osnovna Å¡ola. SlovenÅ¡Äina. [Curriculum. Primary school curriculum. Slovenian]. Revised edition. Ministrstvo za izobraževanje, znanost in Å¡port: Zavod Republike Slovenije za Å¡olstvo.
Raduly Zorgo, E., Smythe, I., Gyarmathy, É., Košak Babuder, M., Kavkler, M., & Magajna, L. (2010). Disleksija – vodnik za tutorje [Dyslexia – A guide for tutors]. Univerza v Ljubljani, Pedagoška fakulteta.
Rief, S. F., & Stern, J. M. (2010). The dyslexia checklist: A practical reference for parents and teachers. Jossey-Bass.
Rooms, M. (2000). Information and communication technology and dyslexia. In Dyslexia in Practice (pp. 263–272). Springer, MA.
Rose, J. (2009) Identifying and teaching children and young people with dyslexia and literacy difficulties: An independent report from Sir Jim Rose to the Secretary of State for Children, Schools and Families. DCSF Publications.
Rüsseler, J., Probst, S., Johannes, S., & Münte, T. F. (2003). Recognition memory for high- and low-frequency words in adult normal and dyslexic readers: An event-related brain potential study. Journal of Clinical and Experimental Neuropsychology, 25(6), 815–829. https://doi.org/10.1076/jcen.25.6.815.16469.
Segalowitz, N., Poulsen, C., & Komoda, M. (1991). Lower level components of reading skill in higher level bilinguals: Implications for reading instruction. AILA review, 8(1), 15–30.
Shaywitz, S. (2003). Overcoming dyslexia: A new and complete science-based program for reading problems at any level. Knopf.
Singleton, C. (2001). Computer-based assessment in education. Educational and Child Psychology.
Snowling, M. J. (2013). Early identification and interventions for dyslexia: A contemporary view. Journal of Research in Special Educational Needs, 13(1), 7–14.
Snowling, M. J., & Hulme, C. (2012). Annual research review: The nature and classification of reading disorders – a commentary on proposals for DSM-5. Journal of Child Psychology and Psychiatry, 53(3), 593–607.
Sprenger-Charolles, L., Siegel, L. S., Jiménez, J. E., & Ziegler, J. C. (2011). Prevalence and reliability of phonological, surface, and mixed profiles in dyslexia: A review of studies conducted in languages varying in orthographic depth. Scientific Studies of Reading, 15(6), 498–521. https://doi.org/10.1080/10888438.2010.524463
Suárez-Coalla, P., & Cuetos, F. (2015). Reading difficulties in Spanish adults with dyslexia. Annals of Dyslexia, 65(1), 33–51. https://doi.org/10.1007/s11881-015-0101-3
Šali, B. (1971). Test motenosti v branju in pisanju (T – MBP) [The reading and writing disability test]. Zavod SR Slovenije za rehabilitacijo invalidov.
Å kvorc, T., Robnik Å ikonja, M., Žagar, A., Arhar Holdt, Å ., Pollak, S., ÄŒibej, J., Pori, E., Kosem, I., Krek, S., & Torkar, G. (n. d.). Za kakovost slovenskih uÄbenikov (KaUÄ) – Aplikacija berljivosti besedila [For the quality of Slovenian textbooks (KaUÄ) – Text readability application]. http://www.kauc.si/aplikacija-berljivosti-besedila/
Weedon, C., & Reid, G. (2018). SNAP-3: Profil ocene posebnih potreb, 3. izdaja: raÄunalniÅ¡ko podprto ocenjevanje in izdelava profila specifiÄnih uÄnih težav (5–14 let): priroÄnik [SNAP-a 3: Special needs assessment profile, 3rd Edition: Computer-assisted assessment and profiling of specific learning disabilities (5–14 years): Manual.] Center za psihodiagnostiÄna sredstva.
In order to ensure both the widest dissemination and protection of material published in CEPS Journal, we ask Authors to transfer to the Publisher (Faculty of Education, University of Ljubljana) the rights of copyright in the Articles they contribute. This enables the Publisher to ensure protection against infringement.
