Koen van Turnhout
ABSTRACT
In this paper we discuss mixed-method research in HCI. We report on an empirical literature study of the NordiCHI 2012 proceedings which aimed to uncover and describe common mixed-method approaches, and to identify good practices for mixed-methods research in HCI. We present our results as mixed-method research design patterns, which can be used to design, discuss and evaluate mixed-method research. Three dominant patterns are identified and fully described and three additional pattern candidates are proposed. With our pattern descriptions we aim to lay a foundation for a more thoughtful application of, and a stronger discourse about, mixed-method approaches in HCI.
- Brown, J. M., Lindgaard, G. and Biddle, R. Joint implicit alignment work of interaction designers and software developers. 693--702Google Scholar
- Dalsgaard, P. and Halskov, K. Tangible 3D tabletops: combining tangible tabletop interaction and 3D projection. 109--118.Google Scholar
- Giusti, L., Xerxes, K., Schladow, A., Wallen, N., Zane, F. and Casalegno, F. Workspace configurations: setting the stage for remote collaboration on physical tasks. 351--360.Google Scholar
- Grubert, J., Grasset, R. and Reitmayr, G. Exploring the design of hybrid interfaces for augmented posters in public spaces. 238--246.Google Scholar
- Gonzalez, B., Carroll, E. and Latulipe, C. Dance-inspired technology, technology-inspired dance. 398--407.Google Scholar
- Hansen, J. P., Glenstrup, A. J., Wusheng, W., Weiping, L. and Zhonghai, W. Collecting location-based voice messages on a TalkingBadge. 219--227.Google Scholar
- Laporte, L., Slegers, K. and De Grooff, D. Using Correspondence Analysis to monitor the persona segmentation process. 265--274.Google Scholar
- Alexander, C., Ishikawa, S. and Silverstein, M. A Pattern Language: Towns, Buildings, Construction. Center for Environmental Structure, 1977Google Scholar
- Bartneck, C. and Rauterberg, M. HCI reality: an "Unreal Tournament"#8482;? International Journal of Human-Computer Studies, 65, 8 (2007), 737--743. Google ScholarDigital Library
- Bergman, M. M. Advances in mixed methods research: Theories and applications. Sage, 2008.Google ScholarCross Ref
- Bødker, S. When second wave HCI meets third wave challenges. In Proceedings of NordiCHI 2006, 1--8. Google ScholarDigital Library
- Borchers, J. O. A pattern approach to interaction design. In AI & Society, 15, 4 (2001), 359--376.Google ScholarDigital Library
- Blomberg, J. and Karasti, H. Positioning ethnography within Participatory Design. In Routledge Handbook of Participatory Design, 2012, 86--116.Google Scholar
- Bryman, A. Why do researchers integrate/combine/mesh/blend/mix/merge/fuse quantitative and qualitative research. Advances in mixed methods research, (2008), 87--100.Google Scholar
- Carroll, J. M. and Kellogg, W. A. Artifact as theory-nexus: Hermeneutics meets theory-based design. In Proceedings of CHI 1989, 7--14. Google ScholarDigital Library
- CHI 2013 Contribution Types. Available from: http://chi2013.acm.org/authors/call-for-participation/papers-notes/selecting-a-contribution-type/Google Scholar
- Cockton, G. Make Evaluation Poverty History. In Proceedings of CHI 2007 (Alt.Chi), ACM Google ScholarDigital Library
- Cockton, G. Revisiting usability's three key principles. In Proceedings of CHI 2008, ACM, 2473--2484 Google ScholarDigital Library
- Creswell, J. W. and Clark, V. L. P. Designing and conducting mixed methods research. Wiley Online Library, 2007.Google Scholar
- Dorst, C. H. Describing Design-A comparison of paradigms. PhD Thesis Delft University of Technology (1997).Google Scholar
- Fallman, D. The interaction design research triangle of design practice, design studies, and design exploration. Design Issues, 24, 3 (2008), 4--18.Google ScholarCross Ref
- Gaver, W. What should we expect from research through design? In Proceedings of CHI 2012. ACM, 937--946. Google ScholarDigital Library
- Greene, J. C., Caracelli, V. J. and Graham, W. F. Toward a conceptual framework for mixed-method evaluation designs. Educational evaluation and policy analysis, 11, 3 (1989), 255--274.Google Scholar
- Gregor, S. and Hevner, A. R. Positioning and Presenting Design Science Research for Maximum Impact. MIS Quarterly, 37, 2 (2013). Google ScholarDigital Library
- Grudin, J. Three faces of human-computer interaction. Annals of the History of Computing, IEEE, 27, 4 (2005), 46--62. Google ScholarDigital Library
- Gwet, K. Handbook of inter-rater reliability. Gaithersburg, MD: STATAXIS Publishing Company, (2001), 223--246.Google Scholar
- Harrison, S., Tatar, D. and Sengers, P. The three paradigms of HCI. In Proceedings of CHI 2007 ACM. ppGoogle Scholar
- Helm, R., Johnson, R., Vlissides, J. and Gamma, E. Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley, 2002.Google Scholar
- Hevner, A. R., March, S. T., Park, J. and Ram, S. Design science in information systems research. MIS quarterly, 28, 1 (2004), 75--105. Google ScholarDigital Library
- Järvinen, P. Research Questions Guiding Selection of an Appropriate Research Method. In ECIS (2000), 124--131.Google Scholar
- Jarvis, N., Cameron, D. and Boucher, A. Attention to detail: annotations of a design process. In proceedings of NordiCHI 2012, ACM, 11--20. Google ScholarDigital Library
- Koskinen, I., Zimmerman, J., Binder, T., Redstrom, J. and Wensveen, S. Design research through practice: From the lab, field, and showroom. Elsevier, 2011. Google ScholarDigital Library
- Mackay, W. E. and Fayard, A. HCI, natural science and design: a framework for triangulation across disciplines. Proceedings of DIS 1997. ACM, 223--234. Google ScholarDigital Library
- McKenney, S. and Reeves, T. Conducting educational design research. (2011).Google Scholar
- Mingers, J. Combining IS research methods: towards a pluralist methodology. Information systems research, 12, 3 (2001), 240--259. Google ScholarDigital Library
- Newman, W. A preliminary analysis of the products of HCI research, using pro forma abstracts. Proceedings of CHI 1994. ACM, 278--284. Google ScholarDigital Library
- Nunamaker Jr, J. F. and Chen, M. Systems development in information systems research. In Proceedings of System Sciences. IEEE, 1990, 631--640.Google Scholar
- Oates, B. J. Researching information systems and computing. Sage, 2005. Google ScholarDigital Library
- Pan, Y. and Stolterman, E. Pattern language and HCI: expectations and experiences. In Proceedings of CHI 2013, ACM, 1989--1998. Google ScholarDigital Library
- Petter, S. C. and Gallivan, M. J. Toward a framework for classifying and guiding mixed method research in information systems. Proceedings of System Sciences 2004. IEEE Google ScholarDigital Library
- Rauterberg, M. HCI as an engineering discipline: to be or not to be!? African Journal of Information & Communication Technology, 2, 4 (2006), 22.Google ScholarCross Ref
- Runkel, P. J. and MacGrath, J. E. Research on human behavior. Holt, Rinehart and Winston. New York, 1972Google Scholar
- Shaw, M. What makes good research in software engineering? International Journal on Software Tools for Technology Transfer, 4, 1 (2002), 1--7.Google ScholarCross Ref
- Turnhout, K. van, Craenmehr, S. Holwerda, R., Menijn, M., Zwart, J. P. and Bakker, R. Trade-offs in Design Research: Development Oriented Triangulation. Proceedings of the BSC HCI Conference 2013. Google ScholarDigital Library
- Whittaker, S., Terveen, L. and Nardi, B. A. Let's stop pushing the envelope and start addressing it: a reference task agenda for HCI. Human--Computer Interaction, 15, 2-3 (2000), 75--106. Google ScholarDigital Library
- Wolf, T. V., Rode, J. A., Sussman, J. and Kellogg, W. A. Dispelling design as the black art of CHI. In Proceedings of CHI 2006. ACM, 521--530. Google ScholarDigital Library
- Zimmerman, J., Forlizzi, J. and Evenson, S. Research through design as a method for interaction design research in HCI. In Proceedings of CHI 2007. ACM, 493--502. Google ScholarDigital Library
Index Terms
- Design patterns for mixed-method research in HCI
Recommendations
Tradeoffs in design research: development oriented triangulation
BCS-HCI '13: Proceedings of the 27th International BCS Human Computer Interaction ConferenceThe Development Oriented Triangulation (DOT) framework in this paper can spark and focus the debate about mixed-method approaches in HCI. The framework can be used to classify HCI methods, create mixed-method designs, and to align research activities in ...
The turn to practice in HCI: towards a research agenda
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThis paper argues that a new paradigm for HCI research, which we label the 'practice' perspective, has been emerging in recent years. This stands in contrast to the prevailing mainstream HCI paradigm, which we term the 'interaction' perspective. The '...
Negotiating "Messy" Research Context and Design Through Adaptive Research Stances: Experience Report
SIGDOC '16: Proceedings of the 34th ACM International Conference on the Design of CommunicationResearchers in communication design increasingly find themselves conducting research in their own communities. Following posthuman and critical methodologies which suggest that research sites are often shifting and messy, this experience report argues ...
Comments