skip to main content
10.1145/2930674.2930696acmconferencesArticle/Chapter ViewAbstractPublication PagesidcConference Proceedingsconference-collections
research-article

Evaluating Engagement in Reading: Comparing Children and Adult Assessors

Published:21 June 2016Publication History

ABSTRACT

This paper describes the findings of a study into how children engage with and enjoy reading digital stories. We considered stories created by children with an application called Fiabot! that we designed to support the creation of multimedia fairy tales in school. We asked a group of 25 volunteers, aged 9 to 12, to act as assessors and read the multimedia fairy tales with the aim of uncovering the key factors that contribute to making stories more engaging for young readers. The same stories were also previously evaluated by teachers who looked at specific quality indicators derived from the educational goals of the fairy tale making exercise. Here we report on how children and adults had very different views on what makes a story engaging. By looking at their contrasting opinions we could get a deeper understanding of the factors and dimensions of engagement that influence the overall enjoyment of a story. This paper ends by discussing how we could use these findings to design more engaging multimedia stories and enhanced eBooks that would be both educational and fun to read.

References

  1. Al-Wabil, Areej, E Alabdulqader, L Al-Abdulkarim, N Al-Twairesh "Measuring the user experience of digital books with children: An eyetracking study of interaction with digital libraries." Internet Technology and Secured Transactions (ICITST), 2010 International Conference for. IEEE, 2010.Google ScholarGoogle Scholar
  2. Biocca, Frank, Chad Harms, and Judee K. Burgoon. "Toward a more robust theory and measure of social presence: Review and suggested criteria." Presence 12.5 (2003): 456--480. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Bolchini, Davide, Nicoletta Di Blas, Franca Garzotto, Paolo Paolini, and Aldo Torrebrunö "Simple, Fast, Cheap: Success Factors for Interactive Multimedia Tools." PsychNology Journal 5.3 (2007): 253--269.Google ScholarGoogle Scholar
  4. Busselle, Rick, and Helena Bilandzic. "Fictionality and perceived realism in experiencing stories: A model of narrative comprehension and engagement." Communication Theory 18.2 (2008): 255--280.Google ScholarGoogle ScholarCross RefCross Ref
  5. Busselle, Rick, and Helena Bilandzic. "Measuring narrative engagement." Media Psychology 12.4 (2009): 321--347.Google ScholarGoogle ScholarCross RefCross Ref
  6. Carbonaro, Mike, et al. "Interactive story authoring: A viable form of creative expression for the classroom." Computers & Education 51.2 (2008): 687--707. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Cohen, Jonathan. "Audience identification with media characters." Psychology of entertainment 13 (2006): 183--197.Google ScholarGoogle Scholar
  8. Colombo, Luca, and Monica Landoni. "A diary study of children's user experience with EBooks using flow theory as framework." Proceedings of the 2014 conference on Interaction design and children. ACM, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Colombo, Luca, Monica Landoni, and Elisa Rubegni. "Design guidelines for more engaging electronic books: insights from a cooperative inquiry study." Proceedings of the 2014 conference on Interaction design and children. ACM, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Di Blas, Nicoletta, and Paolo Paolini. "Beyond the School's Boundaries: PoliCultura, a Large-Scale Digital Storytelling Initiative." Educational Technology & Society 16.1 (2013): 15--27.Google ScholarGoogle Scholar
  11. Jones, Troy, and Carol Brown. "Reading Engagement: A Comparison between E-Books and Traditional Print Books in an Elementary Classroom." Online Submission 4.2 (2011): 5--22.Google ScholarGoogle Scholar
  12. Kaplan, Nancy, Yoram Chisik, and Debra Levy. "Reading in the wild: sociable literacy in practice." Proceedings of the 2006 conference on Interaction design and children. ACM, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Huang, Jin, Yu Chun, Wang Yuntao, Zhao Yuhang, Liu Siqi, Mo Chou, Liu Jie, Zhang Lie, Shi Yuanchun. "FOCUS: enhancing children's engagement in reading by using contextual BCI training sessions." Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Hutchinson, Hilary Browne, Benjamin B. Bederson, and Allison Druin. "The evolution of the international children's digital library searching and browsing interface." Proceedings of the 2006 conference on Interaction design and children. ACM, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Massimi, Michael, Rachelle Campigotto, Abbas Attarwala, and Ronald M. Baecker. "Reading together as a Leisure Activity: Implications for E-reading." Human-Computer Interaction--INTERACT 2013. Springer Berlin Heidelberg, 2013. 19--36.Google ScholarGoogle Scholar
  16. Maynard, Sally. "The impact of e-books on young children's reading habits." Publishing Research Quarterly 26.4 (2010): 236--248.Google ScholarGoogle ScholarCross RefCross Ref
  17. Miranda, Twyla, Dara Williams-Rossi, Kary A. Johnson, Nancy McKenzie."Reluctant readers in middle school: Successful engagement with text using the e-reader." International Journal of Applied Science and Technology 1.6 (2011).Google ScholarGoogle Scholar
  18. Moody, Amelia K., Laura M. Justice, and Sonia Q. Cabell. "Electronic versus traditional storybooks: Relative influence on preschool children's engagement and communication." Journal of Early Childhood Literacy 10.3 (2010): 294--313.Google ScholarGoogle ScholarCross RefCross Ref
  19. OECD (2012) PISA 2012 Results: What Students Know and Can Do (2014) Student Performance in Mathematics, Reading and Science. A Profile of Student Performance in Reading. (Volume I, Revised edition) http://www.oecd.org/pisa/keyfindings/pisa-2012-results-volume-i.htmGoogle ScholarGoogle Scholar
  20. OECD (2013). PISA 2015 Draft Reading Framework http://www.oecd.org/pisa/pisaproducts/pisa2015draftframeworks.htmGoogle ScholarGoogle Scholar
  21. Pera, Maria Soledad, and Yiu-Kai Ng. "With a little help from my friends: Generating personalized book recommendations using data extracted from a social website." Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology-Volume 01. IEEE Computer Society, 2011 Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Roskos, Kathleen, Karen Burstein, and Byeong-Keun You. "A typology for observing children's engagement with ebooks at preschool." Journal of Interactive Online Learning 11.2 (2012): 47--66.Google ScholarGoogle Scholar
  23. Rubegni, Elisa, and Monica Landoni. "Fiabot!: design and evaluation of a mobile storytelling application for schools." Proceedings of the 2014 conference on Interaction design and children. ACM, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Schoenau-Fog, Henrik. "The player engagement process--An exploration of continuation desire in digital games." Think Design Play: Digital Games Research Conference. 2011.Google ScholarGoogle Scholar
  25. Shaw, Catherine, Louca-Mai Brady, and Ciara Davey. "Guidelines for research with children and young people." London: National Children's Bureau Research Centre (2011).Google ScholarGoogle Scholar
  26. Sim, Gavin, Stuart MacFarlane, and Janet Read. "All work and no play: Measuring fun, usability, and learning in software for children." Computers & Education 46.3 (2006): 235--248. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Zagalo, Nelson, Sandy Louchart, and Maria T. Soto-Sanfiel. "Users and evaluation of interactive storytelling." Interactive Storytelling. Springer Berlin Heidelberg, 2010. 287--288. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Zagalo, N., Sandy Louchart and Maria T. Soto-Sanfiel. (2010). "Users and Evaluation of Interactive Storytelling." ICIDS 2010, LNCS 6432. 287--288 Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Evaluating Engagement in Reading: Comparing Children and Adult Assessors

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      IDC '16: Proceedings of the The 15th International Conference on Interaction Design and Children
      June 2016
      774 pages
      ISBN:9781450343138
      DOI:10.1145/2930674

      Copyright © 2016 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 21 June 2016

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      IDC '16 Paper Acceptance Rate36of77submissions,47%Overall Acceptance Rate172of578submissions,30%

      Upcoming Conference

      IDC '24
      Interaction Design and Children
      June 17 - 20, 2024
      Delft , Netherlands

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader