skip to main content
10.1145/2470654.2481285acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Analyzing users' narratives to understand experience with interactive products

Published:27 April 2013Publication History

ABSTRACT

Recent research in user experience (UX) has studied narratives, users' account of their interaction with technology. It has emphasized specific constructs (e.g., affect, needs, hedonics) and their interrelation, but rarely analyzed the content of the narratives. We analyze the content and structure of 691 user-generated narratives on positive and negative experiences with technology. We use a multi-method approach consisting of manual (structural analysis of narratives) as well as of automated content analysis methods (psycholinguistic analysis and machine learning). These analyses show converging evidence that positive narratives predominantly concern social aspects such as family and friends. In addition, technology is positively experienced when it enables users to do things more efficiently or in a new way. In contrast, negative narratives often express anger and frustration due to technological failures. Our multi-method approach illustrates the potential of automated (as opposed to manual) content analysis methods for studying text-based experience reports.

References

  1. Aronson, J. A pragmatic view of thematic analysis. The Qualitative Report, 2, 1 (1994), 1--3.Google ScholarGoogle Scholar
  2. Arrasvuori, J., Korhonen, H. and Väänänen-Vainio-Mattila, K. Exploring playfulness in user experience of personal mobile products. In Proc. OZCHI 2010. ACM (2010), 88--95. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Bargas-Avila, J. and Hornbæk, K. Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. In Proc. CHI 2011. ACM Press (2011), 2689--2698. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Beyer, H. and Holtzblatt, K. Contextual design. interactions, 6, 1 (1999), 32--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Buhrmester, M., Kwang, T. and Gosling, S. D. Amazon's Mechanical Turk A New Source of Inexpensive, Yet High-Quality, Data? Perspectives on Psychological Science, 6, 1 (2011), 3--5.Google ScholarGoogle ScholarCross RefCross Ref
  6. Field, A. P. Discovering statistics using SPSS. SAGE publications Ltd, 2009.Google ScholarGoogle Scholar
  7. Habermas, T. and Berger, N. Retelling everyday emotional events: Condensation, distancing, and closure. Cognition and Emotion, 25, 2 (2011), 206--219.Google ScholarGoogle ScholarCross RefCross Ref
  8. Hassenzahl, M. The interplay of beauty, goodness, and usability in interactive products. Human-Computer Interaction, 19, 4 (2004), 319--349. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Hassenzahl, M., Diefenbach, S. and Göritz, A. Needs, affect, and interactive products - Facets of user experience. Interacting with Computers, 22, 5 (2010), 353--362. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Hassenzahl, M. and Monk, A. The inference of perceived usability from beauty. Human-Computer Interaction, 25, 3 (2010), 235--260.Google ScholarGoogle ScholarCross RefCross Ref
  11. Hassenzahl, M. and Tractinsky, N. User experience - a research agenda. Behaviour & Information Technology, 25 2(2006), 91--99.Google ScholarGoogle ScholarCross RefCross Ref
  12. Karapanos, E., Zimmerman, J., Forlizzi, J. and Martens, J.-B. User experience over time: an initial framework. In Proc. CHI 2009. ACM (2009), 729--738. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Kittur, A., Chi, E. H. and Suh, B. Crowdsourcing user studies with Mechanical Turk. In Proc. CHI 2008. ACM (2008), 453--456. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Klein, D. and Manning, C. D. Optimization, Maxent Models, and Conditional Estimation without Magic. Tutorial delivered at HLT-NAACL 2003(2003). Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Korhonen, H., Arrasvuori, J. and Väänänen-Vainio-Mattila, K. Let Users Tell the Story: Evaluating User Experience with Experience Reports. In Proc. CHI 2010 Ext. Abs. (2010), 4051--4056. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Kramer, A. D. I. and Rodden, K. Word usage and posting behaviors: modeling blogs with unobtrusive data collection methods. In Proc. CHI 2008. ACM (2008), 1125--1128. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Labov, W. The transformation of experience in narrative syntax. In, Language in the Inner City: Studies in the Black Venacular. University of Pennsylvania Press, Philadelphia, PA, 1972.Google ScholarGoogle Scholar
  18. Labov, W. and Waletzky, J. Narrative analysis: Oral versions of personal experience. In J. Helm (ed.), Essays on the Verbal and Visual Arts, 12--44. Seattle, 1967.Google ScholarGoogle Scholar
  19. McCarthy, J. and Wright, P. Technology as Experience. MIT Press, Cambridge, MA, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Nigam, K., Lafferty, J. and McCallum, A. Using maximum entropy for text classification. In Proc. IJCAI 1999 (1999), 61--67.Google ScholarGoogle Scholar
  21. Olsson, T. and Salo, M. Narratives of satisfying and unsatisying experiences of current mobile augmented reality applications. In Proc. CHI 2012 (2012), 2779--2788. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Pang, B., Lee, L. and Vaithyanathan, S. Thumbs up?: sentiment classification using machine learning techniques. In Proc. EMNLP 2002. ACL (2002), 79--86. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Partala, T. and Kallinen, A. Understanding the most satisfying and unsatisfying user experiences: Emotions, psychological needs, and context. Interacting with Computers, 24(2012), 25--34. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Pennebaker, J. W., Chung, C. K., Ireland, M., Gonzales, A. and Booth, R. J. The development and psychometric properties of LIWC2007. www.liwc.net, 2007.Google ScholarGoogle Scholar
  25. Pennebaker, J. W., Francis, M. E. and Booth, R. J. Linguistic inquiry and word count: LIWC 2001. Erlbaum Publishers, Mahwah, NJ, 2001.Google ScholarGoogle Scholar
  26. Riessman, C. K. Narrative methods for the human sciences. SAGE, Los Angeles, 2008.Google ScholarGoogle Scholar
  27. Rime, B., Mesquita, B., Philippot, P. and Boca, S. Beyond the Emotional Event - 6 Studies on the Social Sharing of Emotion. Cognition Emotion, 5, 5-6 (1991), 435--465.Google ScholarGoogle ScholarCross RefCross Ref
  28. Ryan, R. M. and Deci, E. L. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55, 1 (2000), 68--78.Google ScholarGoogle ScholarCross RefCross Ref
  29. Scherer, K. R. Appraisal considered as a process of multilevel sequential checking. Appraisal processes in emotion: Theory, methods, research, 92(2001), 120.Google ScholarGoogle Scholar
  30. Scissors, L. E., Gill, A. J., Geraghty, K. and Gergle, D. In CMC we trust: the role of similarity. In Proc. CHI 2009. ACM (2009), 527--536. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Sheldon, K. M., Elliot, A. J., Kim, Y. and Kasser, T. What is satisfying about satisfying events? Testing 10 candidate psychological needs. Journal of Personality and Social Psychology, 80, 2 (2001), 325--339.Google ScholarGoogle ScholarCross RefCross Ref
  32. Tausczik, Y. R. and Pennebaker, J. W. The psychological meaning of words: LIWC and computerized text analysis methods. Journal of Language and Social Psychology, 29, 1 (2010), 24--54.Google ScholarGoogle ScholarCross RefCross Ref
  33. Watson, D., Clark, L. A. and Tellegen, A. Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54, 6 (1988), 1063--1070.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Analyzing users' narratives to understand experience with interactive products

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
      April 2013
      3550 pages
      ISBN:9781450318990
      DOI:10.1145/2470654

      Copyright © 2013 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 27 April 2013

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Author Tags

      Qualifiers

      • research-article

      Acceptance Rates

      CHI '13 Paper Acceptance Rate392of1,963submissions,20%Overall Acceptance Rate6,199of26,314submissions,24%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader