skip to main content
10.1145/1518701.1519040acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Anatomy of a failure: how we knew when our design went wrong, and what we learned from it

Authors Info & Claims
Published:04 April 2009Publication History

ABSTRACT

In this paper, we describe the failure of a novel sensor-based system intended to evoke user interpretation and appropriation in domestic settings. We contrast participants' interactions in this case study with those observed during more successful deployments to identify 'symptoms of failure' under four themes: engagement, reference, accommodation, and surprise and insight. These themes provide a set of sensitivities or orientations that may complement traditional task-based approaches to evaluation as well as the more open-ended ones we describe here. Our system showed symptoms of failure under each of these themes. We examine the reasons for this at three levels: problems particular to the specific design hypothesis; problems relevant for input-output mapping more generally; and problems in the design process we used. We conclude by noting that, although interpretive systems such as the one we describe here may succeed in a myriad of different ways, it is reassuring to know that they can also fail, and fail incontrovertibly, yet instructively.

References

  1. Bødker, S. When Second Wave HCI meets Third Wave challenges. NordCHI 2006. (2006). Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Boehner, K., DePaula, R., Dourish, P., and Sengers, P. Affect: from information to interaction. Proc. CC '05. ACM, (2005), 59--68. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Cooper, G. and Bowers, J., Representing the user. In Thomas, P. (ed.), The social and interactional dimensions of human-computer interfaces. New York: Cambridge University Press (1995). Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Gaver, W. (2007). Cultural commentators: Non-native interpretations as resources for polyphonic assessment. International Journal of Human-Computer Studies, 65, 4 (2007), 292--305. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Gaver, W., Bowers, J., Boucher, A., Law, A., and Pennington, S. Electronic furniture for the Curious Home: Assessing ludic designs in the field. International Journal of Human-Computer Interaction, 22, 1-2 (2007), 119--152.Google ScholarGoogle ScholarCross RefCross Ref
  6. Gaver, W., Sengers, P., Kerridge, T., Kaye, J., and Bowers, J. Enhancing ubiquitous computing with user interpretation: field testing the home health horoscope. Proc. CHI '07 ACM (2007), 537--546. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Harrison S, Tatar D, Sengers P. The three paradigms of HCI. alt.CHI'07. (2007).Google ScholarGoogle Scholar
  8. Höök, K., Sengers, P., and Andersson, G. Sense and sensibility: evaluation and interactive art. Proc. CHI '03. ACM (2003), 241--248. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Isbister, K., Höök, K., Sharp, M., and Laaksolahti, J. The sensual evaluation instrument: developing an affective evaluation tool. Proc. CHI '06. ACM (2006). 1163--1172. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. McCarthy J, Wright P: Technology as Experience. MIT Press (2004). Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Romero, M., Pousman, Z., and Mateas, M. Tableau machine: an alien presence in the home. CHI '06 Extended Abstracts, ACM, (2006), 1265--1270. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Sengers, P. and Gaver, W. Staying Open to interpretation: Engaging multiple meanings in design and evaluation. Proc. DIS 2006. ACM Press (2006). Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Zimmerman, J., Forlizzi, J., and Evenson, S. Research through design as a method for interaction design research in HCI. Proc. CHI '07. ACM, (2007), 493--502. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Anatomy of a failure: how we knew when our design went wrong, and what we learned from it

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
      April 2009
      2426 pages
      ISBN:9781605582467
      DOI:10.1145/1518701

      Copyright © 2009 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 4 April 2009

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      CHI '09 Paper Acceptance Rate277of1,130submissions,25%Overall Acceptance Rate6,199of26,314submissions,24%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader