Shaun K. Kane
Barbara Linam-Church
ABSTRACT
Many people with aphasia experience difficulty recalling words extemporaneously, but can recognize those words when given an image, text, or audio prompt. Augmented and alternative communication (AAC) systems can help address this problem by enabling people with aphasia to browse and select from a list of vocabulary words. However, these systems can be difficult to navigate, especially when they contain large amounts of content. In this paper, we describe the design of TalkAbout, a context-aware, adaptive AAC system that provides users with a word list that is adapted to their current location and conversation partner. We describe the design and development of TalkAbout, which we conducted in collaboration with 5 adults with aphasia. We then present guidelines for developing and evaluating context-aware technology for people with aphasia.
- Al Mahmud, A. and Martens, J.-B. Re-connect: designing accessible email communication support for persons with aphasia. Proc. CHI EA '10, ACM Press (2010), 3505--3510. Google Scholar
Digital Library
- Allen, M., McGrenere, J., and Purves, B. The design and field evaluation of PhotoTalk: a digital image communication application for people with aphasia. Proc. ASSETS '07, ACM Press (2007), 187--194. Google ScholarDigital Library
- Baecker, R.M., Moffatt, K., and Massimi, M. Technologies for aging gracefully. interactions 19, 3 (2012), 32--36. Google ScholarDigital Library
- Beukelman, D.R. and Mirenda, P. Augmentative & Alternative Communication: Supporting Children & Adults With Complex Communication Needs. Paul H Brookes Pub Co, 2006.Google Scholar
- Boyd-Graber, J.L., Nikolova, S.S., Moffatt, K.A., Kin, K.C., Lee, J.Y., Mackey, L.W., Tremaine, M.M., and Klawe, M.M. Participatory design with proxies: developing a desktop-PDA system to support people with aphasia. Proc. CHI '06, ACM Press (2006), 151--160. Google ScholarDigital Library
- Davies, R., Marcella, S., McGrenere, J., and Purves, B. The ethnographically informed participatory design of a PD application to support communication. Proc. ASSETS '04, ACM Press (2004), 153--160. Google ScholarDigital Library
- Fenwick, K., Massimi, M., Baecker, R., Black, S., Tonon, K., Munteanu, C., Rochon, E., and Ryan, D. Cell phone software aiding name recall. Proc. CHI '09 EA, ACM Press (2009), 4279--4284. Google ScholarDigital Library
- Guerreiro, T., Nicolau, H., Jorge, J., and Gonçalves, D. Towards accessible touch interfaces. Proc. ASSETS '10, ACM Press (2010), 19--26. Google ScholarDigital Library
- Hailpern, J., Danilevsky, M., Harris, A., Karahalios, K., Dell, G., and Hengst, J. ACES: promoting empathy towards aphasia through language distortion emulation software. Proc. CHI '11, ACM Press (2011), 609--618. Google ScholarDigital Library
- Hier, D.B., Mondlock, J., and Caplan, L.R. Behavioral abnormalities after right hemisphere stroke. Neurology 33, 3 (1983), 337--344.Google Scholar
- Hightower, J. and Borriello, G. Location systems for ubiquitous computing. Computer 34, 8 (2001), 57--66. Google ScholarDigital Library
- Kagan, A., Simmons-Mackie, N., Rowland, A., Huljbregts, M., Shumway, E., McEwen, S., Threats, T., and Sharp, S. Counting what counts: a framework for capturing real-life outcomes of aphasia interventions. Aphasiology 22, 3 (2008), 258--280.Google ScholarCross Ref
- Kane, S.K., Jayant, C., Wobbrock, J.O., and Ladner, R.E. Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities. Proc. ASSETS '09, ACM Press (2009), 115--122. Google ScholarDigital Library
- Krishna, S., Little, G., Black, J., and Panchanathan, S. iCARE interaction assistant: a wearable face recognition system for individuals with visual impairments. Proc. ASSETS '05, ACM Press (2005), 216--217. Google ScholarDigital Library
- McGrenere, J., Davies, R., Findlater, L., Graf, P., Klawe, M., Moffatt, K., Purves, B., and Yang, S. Insights from the aphasia project: designing technology for and with people who have aphasia. Proc. CUU '03, ACM Press (2003), 112--118. Google ScholarDigital Library
- Moffatt, K., McGrenere, J., Purves, B., and Klawe, M. The participatory design of a sound and image enhanced daily planner for people with aphasia. Proc. CHI '04, ACM Press (2004), 407--414. Google ScholarDigital Library
- Sohlberg, M.M., Fickas, S., Ehlhardt, L., and Todis, B. The longitudinal effects of accessible email for individuals with severe cognitive impairments. Aphasiology 19, 7 (2005), 651--68Google Scholar
- Piper, A.M., Weibel, N., and Hollan, J.D. Write-N-Speak: authoring multimodal digital-paper materials for speech-language therapy. ACM Transactions on Accessible Computing 4, 1 (2011), 1--20. Google ScholarDigital Library
- Schilit, B., Adams, N., and Want, R. Context-aware computing applications. IEEE Workshop on Mobile Computing Systems and Applications, IEEE (1994), 85--90. Google ScholarDigital Library
- Sánchez, J. and de la Torre, N. Autonomous navigation through the city for the blind. Proc. ASSETS '10, ACM Press (2010), 195--202. Google ScholarDigital Library
- Tee, K., Moffatt, K., Findlater, L., MacGregor, E., McGrenere, J., Purves, B., and Fels, S.S. A visual recipe book for persons with language impairments. Proc. CHI '05, ACM Press (2005), 501--510. Google ScholarDigital Library
- Turk, M.A. and Pentland, A.P. Face recognition using eigenfaces. Computer Vision and Pattern Recognition, IEEE (1991), 586--591.Google Scholar
- Vance, A. Insurers fight speech-impairment remedy. The New York Times, September 15 2009.Google Scholar
- Viola, P. and Jones, M. Robust real-time face detection. International Journal of Computer Vision 57, 2, (2004), 137--154. Google ScholarDigital Library
- Wisenburn, B. and Higginbotham, D. An AAC application using speaking partner speech recognition to automatically produce contextually relevant utterances: objective results. Augmentative and Alternative Communication 24, 2, (2008), 100--109.Google ScholarCross Ref
Index Terms
- What we talk about: designing a context-aware communication tool for people with aphasia
Recommendations
Communication Needs of Individuals with Aphasia and Caregivers in Unplanned Activities
Universal Access in Human-Computer InteractionAbstractPeople with Aphasia (PWA) have communication difficulties that affect their daily activities and ability to live independently and increase the risk of social isolation. Most of their daily activities are planned and primarily performed in ...
Investigating Mobile Accessibility Guidance for People with Aphasia
ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and AccessibilityThe World Wide Web Consortium's (W3C) Web Content Accessibility Guidelines (WCAG 2.0) have become widely accepted as the standard for web accessibility evaluation. This poster investigates how the mobile version of these guidelines caters for people ...
The design and field evaluation of PhotoTalk: a digital image communication application for people
Assets '07: Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibilityTalk is an application for a mobile device that allows people with aphasia to capture and manage digital photographs to support face-to-face communication. Unlike any other augmentative and alternative communication device for people with aphasia, ...
Comments