Cecilia Oyugi
ABSTRACT
This paper reviews issues and problems that arise in cross-cultural usability evaluations. It reports two separate empirical studies of a number of well-known techniques with UK, African and Indian users. The studies examine the effectiveness of methods based on think-aloud protocols, including the DUCE method, to elicit users' views. The results from all the studies show that these established Western methods are less effective with users from other cultures. It suggests that the reasons for this are the consequences of deep-rooted differences in personal interactions in different cultures. This paper provides evidence to guide choices for applications involving users from India and Africa.
- Abdelnour-Nocera, J., Dunckley, L. and Sharpe, H. (2007), An Approach to the Evaluation of Usefulness as a Social Construct International Journal of Human Computer Interaction, 2007, Vol. 22, No. 1--2, 153--172.Google Scholar
- Del Galdo, E. M (1996) Culture and Design. In E. del Galdo and J. Nielsen (Eds.) International User Interfaces. John Wiley and Sons, Inc. 74--87. Google ScholarDigital Library
- Chavan, A. (2004), The Bollywood Method. in E. Schaffer,. Institutionalization of Usability; a Step-by-Step Guide. New York: Adisson Wesley. 129--130.Google Scholar
- Dray, S. (2001) Usable for the World: A practical guide to International User Studies in D. Day and L. Dunckley (Eds.) Designing for Global Markets 3, Proceedings of IWIPS 2001, pp 154--155. IWIPS.Google Scholar
- Dunckley L, Smith, A & Howard, D (1999). 'Designing for Shared Interfaces with diverse user groups.' INTERACT 99, pp 630.636. Eds. M. A. Sasse, C. Johnson. Chapman & Hall. 1999.Google Scholar
- Evers, V. (2001) Cultural Aspects of User Interface Understanding: An Empirical Evaluation of an E-learning Website by International User Groups. PhD Thesis, Open University.Google Scholar
- Falzon, P (1990). Human-computer interaction: Lessons from human-human communication. In P. Falzon (ed.) Cognitive Ergonomics (pp 51--68). London: Academic Press. Google ScholarDigital Library
- Goguen, J. A. (1996), Formality and informality in requirements engineering, Proceedings of the second international conference on requirements engineering, (ICRE'96), IEEE Computer Society Press, pp 102--108. Google ScholarDigital Library
- Hall, E. T. (1976) Beyond Culture, Doubleday, Garden City, New York.Google Scholar
- Henderson, R. D., Smith, M. C., Podd, J., Varel, A. and Alvarez, H. (1995) A Comparison Of The 4 Prominent User-Based Methods for Evaluating the Usability of Computer Software. Ergonomics, 38, 10, 2030--2044.Google ScholarCross Ref
- Herman, L. (1996) "Towards Effective Usability Evaluation in Asia: Cross-Cultural Differences," ozchi, p. 0135, 6th Australian Conference on Computer-Human Interaction (OZCHI '96). Google ScholarDigital Library
- Hofstede, G. (2001) Culture's Consequences: Comparing Values, Behaviors, Institutions, and Organizations Across Nations. Thousand Oaks CA: Sage Publications.Google Scholar
- Lin, H. X., Choong, Y. and Salvendy, G. (1997), A proposed index of usability: a method for comparing the relative usability of different software systems, Behaviour and IT, 16 (4 and 5), 267--278.Google Scholar
- Murphy, J. (2001) Modelling, designer-tester-subject relationships in international usability testing, in D. Day and L. Dunckley (Eds.) Designing for Global Markets 3 pp 33--44. IWIPS.Google Scholar
- Norman, D. (1988) The Psychology of Everyday Things. Basic Books, New York.Google Scholar
- Smith, A. & Dunckley, L. (2002) Prototype evaluation and redesign: structuring the design space through contextual techniques. Interacting with Computers. 14, DEC (6): 821--843.Google Scholar
- Smith A, Dunckley L, French T, Minocha S, Chang Y (2004) A process model for developing usable crosscultural websites. Interacting with Computers, 16, (1): 63--91.Google ScholarCross Ref
- Smith, A., Gulliksen, J., and Bannon, L. (2005) Building usability in India: reflections from the Indo European Systems Usability Partnership, in T. McEwan, J. Gulliksen and D. Benyon (Eds.) People and Computers XIX - The Bigger Picture: Proceedings of HCI 2005 Springer.Google Scholar
- Spolsky, B. (1989). Conditions for Second Language Learning. Oxford: Oxford University Press.Google Scholar
- Suinn, R. M., Ahuna, C. and Khoo, G. (1992) The Suinn-Lew Asian Self-Identity Acculturation Scale: Concurrent and Factorial Validation. Educational & Psychological Measurement 52(4), pp. 1041--1046.Google Scholar
- Vatrapu, R. and Pérez-Quiñones, M. A. (2006), Culture and Usability Evaluation: The Effects of Culture in Structured Interviews, Journal of Usability Studies, Issue 4, Volume 1, pp. 156--170.Google Scholar
- Wright, P. C. and Monk, A. F. (1991) A cost-effective evaluation method for use by designers. International Journal of Man-Machine Studies. 35 891--912. Google ScholarDigital Library
- Yeo, A. (2000), Usability Evaluation in Malaysia. Proceedings of 4th Asia Pacific Computer Human Interaction Conference: APCHI 2000. Elsevier, pp 275--280.Google Scholar
- Yeo, A. (2001) Global Software Development Lifecycle: An Exploratory Study. In Jacko, J., Sears, A. Beaudouin-Lafon, M. and Jacob, R. (Eds.) CHI 2001: Conference on Human Factors in Computing Systems. ACM Press, pp 104--111. Google ScholarDigital Library
Index Terms
- Evaluation methods and cultural differences: studies across three continents
Recommendations
Culture and usability evaluation: the effects of culture in structured interviews
A major impediment in global user interface development is that there is inadequate empirical evidence for the effects of culture in the usability engineering methods used for developing these global user interfaces. This paper presents a controlled ...
Interpretation of a cross-cultural usability evaluation: A case study based on a hypermedia system for rare species management in Namibia
We present the results of a usability evaluation of a locally developed hypermedia information system aiming at conservation biologists and wildlife managers in Namibia. Developer and end user come from different ethnic backgrounds, as is common to ...
Harambee: a novel usability evaluation method for low-end users in Kenya
NordiCHI '14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, FoundationalThe research reported in this paper seeks to advance the discussion on cultural usability and its implementation among non-western users. This investigation focuses on the effect of culture on the quality of usability evaluation results among Kenyan ...
Comments