Skip to main content
SpringerLink
Log in

Conversational Interfaces: Devices, Wearables, Virtual Agents, and Robots

  • Chapter
  • First Online:
The Conversational Interface

Abstract

We are surrounded by a plethora of smart objects such as devices, wearables, virtual agents, and social robots that should help to make our life easier in many different ways by fulfilling various needs and requirements. A conversational interface is the best way to communicate with this wide range of smart objects. In this chapter, we cover the special requirements of conversational interaction with smart objects, describing the main development platforms, the possibilities offered by different types of device, and the relevant issues that need to be considered in interaction design.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://quantifiedself.com. Accessed February 22, 2016.

  2. 2.

    http://developer.android.com/wear/index.html. Accessed February 22, 2016.

  3. 3.

    http://developer.getpebble.com/. Accessed February 22, 2016.

  4. 4.

    https://developer.apple.com/watchkit/. Accessed February 22, 2016.

  5. 5.

    https://developers.google.com/fit/. Accessed February 22, 2016.

  6. 6.

    https://developer.apple.com/healthkit/. Accessed February 22, 2016.

  7. 7.

    https://www.myo.com/. Accessed February 22, 2016.

  8. 8.

    http://developer.sonymobile.com/products/smarteyeglass/. Accessed February 22, 2016.

  9. 9.

    https://www.microsoft.com/microsoft-hololens/en-us/development-edition. Accessed 17 April 2016.

  10. 10.

    http://www.laforgeoptical.com/. Accessed February 22, 2016.

  11. 11.

    http://www.vinaya.com/. Accessed February 22, 2016.

  12. 12.

    https://ringly.com/. Accessed February 22, 2016.

  13. 13.

    http://www.memijewellery.com/. Accessed February 22, 2016.

  14. 14.

    https://www.bellabeat.com/. Accessed February 22, 2016.

  15. 15.

    https://store.misfit.com/. Accessed February 22, 2016.

  16. 16.

    http://earosmart.com/. Accessed February 22, 2016.

  17. 17.

    http://www.catapultsports.com/uk/. Accessed February 22, 2016.

  18. 18.

    http://www.hexoskin.com/. Accessed February 22, 2016.

  19. 19.

    http://omsignal.com/pages/omsignal-bra. Accessed February 22, 2016.

  20. 20.

    http://www.heddoko.com/. Accessed February 22, 2016.

  21. 21.

    http://www.sensoriafitness.com/. Accessed February 22, 2016.

  22. 22.

    http://developer.android.com/intl/es/training/wearables/apps/voice.html. Accessed February 22, 2016.

  23. 23.

    https://developer.apple.com/library/ios/documentation/AVFoundation/Reference/AVSpeechSynthesizer_Ref. Accessed February 22, 2016.

  24. 24.

    https://msdn.microsoft.com/en-us/library/windows/apps/jj720572%28v=vs.105%29.aspx. Accessed February 22, 2016.

  25. 25.

    https://blog.intercom.io/why-cards-are-the-future-of-the-web/. Accessed February 22, 2016.

  26. 26.

    https://www.google.com/landing/now/#cards. Accessed February 22, 2016.

  27. 27.

    https://speakerdeck.com/christse/patterns-of-card-ui-design. Accessed February 22, 2016.

  28. 28.

    More in: https://www.google.com/design/spec/components/cards.html#cards-actions. Accessed February 22, 2016.

  29. 29.

    http://thenextweb.com/dd/2015/06/16/how-cards-are-taking-over-web-design/. Accessed February 22, 2016.

  30. 30.

    http://ux.stackexchange.com/questions/60495/what-are-the-advantages-of-a-card-centric-user-interface. Accessed February 22, 2016.

  31. 31.

    http://perso.telecom-paristech.fr/~pelachau/Greta/. Accessed February 24, 2016.

  32. 32.

    https://vhtoolkit.ict.usc.edu/. Accessed February 24, 2016.

  33. 33.

    http://smartbody.ict.usc.edu. Accessed February 24, 2016.

  34. 34.

    http://www.techfak.uni-bielefeld.de/~skopp/max.html. Accessed February 24, 2016.

  35. 35.

    https://www.aldebaran.com/en/humanoid-robot/nao-robot. Accessed February 22, 2016.

  36. 36.

    https://www.aldebaran.com/en/a-robots/who-is-pepper. Accessed February 22, 2016.

  37. 37.

    http://projetromeo.com/en/. Accessed February 22, 2016.

  38. 38.

    http://www.theverge.com/2016/1/6/10726082/softbank-pepper-ibm-watson-collaboration. Accessed February 22, 2016.

  39. 39.

    https://www.jibo.com/. Accessed February 22, 2016.

  40. 40.

    https://www.youtube.com/watch?v=3N1Q8oFpX1Y. Accessed February 22, 2016.

  41. 41.

    http://www.furhatrobotics.com/. Accessed February 22, 2016.

  42. 42.

    https://www.youtube.com/watch?v=v84e6HMFbyc. Accessed February 22, 2016.

  43. 43.

    http://www.aisoy.com/.

  44. 44.

    http://www.amazon.com/echo. Accessed February 22, 2016.

  45. 45.

    http://www.hello-robo.com/. Accessed March 1, 2016.

  46. 46.

    http://inmoov.fr. Accessed March 1, 2016.

  47. 47.

    http://www.openrobothardware.org/linkedprojects. Accessed February 22, 2016.

  48. 48.

    http://www.icub.org/. Accessed February 22, 2016.

  49. 49.

    http://www.dis.uniroma1.it/~labrococo/?q=node/373. Accessed February 22, 2016.

  50. 50.

    http://www.ros.org/. Accessed February 22, 2016.

  51. 51.

    http://www.tandfonline.com/toc/utis20/31/3. Accessed February 22, 2016.

  52. 52.

    http://robohub.org/the-next-era-of-conversational-technology/. Accessed February 22, 2016.

  53. 53.

    http://mobilevoiceconference.com/. Accessed February 22, 2016.

  54. 54.

    http://citia.lt-innovate.eu/. Accessed February 22, 2016.

  55. 55.

    https://www.wearable-technologies.com. Accessed February 22, 2016.

  56. 56.

    http://urbanwearables.technology/. Accessed February 22, 2016.

  57. 57.

    http://www.hexoskin.com/pages/health-research. Accessed February 22, 2016.

  58. 58.

    http://www.ubtrobot.com/en/html/archive/2015092816.html. Accessed February 22, 2016.

  59. 59.

    http://www.icsoro.org/. Accessed February 22, 2016.

  60. 60.

    http://link.springer.com/journal/12369. Accessed February 22, 2016.

  61. 61.

    http://www.anvil-software.org/.

  62. 62.

    http://www.icd.cs.tut.ac.jp/en/project.html. Accessed 12 April 2016.

References

  • Al Moubayed S., Beskow J, Skantze G, Granström B (2012) Furhat: A Back-projected human-like robot head for multiparty human-machine interaction. In: Esposito A, Esposito AM, Vinciarelli A, Hoffmann R, Müller VC (eds) Cognitive Behavioural Systems. Lecture Notes in Computer Science Vol. 7403, Springer Verlag, Berlin:114–130. doi:10.1007/978-3-642-34584-5_9

    Google Scholar 

  • André E, Pelachaud C (2010) Interacting with embodied conversational agents. In: Chen F, Jokinen K (eds) Speech technology: theory and applications. Springer, New York, pp 122–149. doi:10.1007/978-0-387-73819-2_8

    Google Scholar 

  • Ardito C, Costabile MF, Jetter H-C (2014) Gestures that people can understand and use. J Vis Lang Comput 25:572–576. doi:10.1016/j.jvlc.2014.07.002

    Article  Google Scholar 

  • Awaad I, Kraetzschmar GK, Hertzberg J (2015) The role of functional affordances in socializing robots. Int J Soc Robot 7:421–438. doi:10.1007/s12369-015-0281-3

    Article  Google Scholar 

  • Baker PMA, Gandy M, Zeagler C (2015) Innovation and wearable computing: a proposed collaborative policy design framework. IEEE Internet Comput 19:18–25. doi:10.1109/MIC.2015.74

    Article  Google Scholar 

  • Baron NS (2015) Shall we talk? Conversing with humans and robots. Inf Soc 31:257–264. doi:10.1080/01972243.2015.1020211

    Article  Google Scholar 

  • Bastianelli E, Nardi D, Aiello LC et al (2015) Speaky for robots: the development of vocal interfaces for robotic applications. Appl Intell 1–24. doi:10.1007/s10489-015-0695-5

    Google Scholar 

  • Bedri A, Sahni H, Thukral P et al (2015) Toward silent-speech control of consumer wearables. Computer 48:54–62. doi:10.1109/MC.2015.310

    Article  Google Scholar 

  • Benyon D, Mival O (2007) Introducing the Companions project: Intelligent, persistent, personalised interfaces to the Internet. In: Proceedings of the 21st British HCI group annual conference on people and computers: HCI…but not as we know it (BCS-HCI’07), pp 193–194. http://dl.acm.org/citation.cfm?id=1531462&dl=ACM&coll=DL&CFID=566912806&CFTOKEN=59937217

  • Bickmore T, Cassell J (2005) Social dialogue with embodied conversational agents. In: Kuppevelt J, Dy L, Bernsen NO (eds) Advances in natural multimodal dialogue systems. Springer, Netherlands, pp 23–54. doi:10.1007/1-4020-3933-6_2

    Google Scholar 

  • Borenstein J, Arkin R (2016) Robotic nudges: the ethics of engineering a more socially just human being. Sci Eng Ethics 22:31–46. doi:10.1007/s11948-015-9636-2

    Article  Google Scholar 

  • Breazeal C (2003) Emotion and sociable humanoid robots. Int J Hum-Comput Stud 59:119–155. doi:10.1016/S1071-5819(03)00018-1

    Article  Google Scholar 

  • Breazeal C (2004) Social interactions in HRI: the robot view. IEEE Trans Syst Man Cybern Part C Appl Rev 34:181–186. doi:10.1109/TSMCC.2004.826268

    Article  Google Scholar 

  • Calvo RA, Peters D (2014) Positive computing: technology for wellbeing and human potential. The MIT Press, Cambridge, MA

    Google Scholar 

  • Cassell J (2001) Embodied conversational agents. representation and intelligence in user interfaces. In: Proceedings of the American Association for the advancement of artificial intelligence (AAAI’01), pp 67–83. http://dx.doi.org/10.1609/aimag.v22i4.1593

  • Cassell J, Sullivan J, Prevost S, Churchill EF (eds) (2000) Embodied conversational agents. MIT Press, Cambridge

    Google Scholar 

  • Chan M, Estève D, Fourniols J-Y, Escriba C, Campo E (2012) Smart wearable systems: current status and future challenges. Artif Intell Med 56:137–156. doi:10.1016/j.artmed.2012.09.003

    Article  Google Scholar 

  • Chen L, Javaid M, Di Eugenio B, Zefran M (2015) The roles and recognition of haptic-ostensive actions in collaborative multimodal human-human dialogues. Comp Speech Lang 34(1):201–231. doi:10.1016/j.csl.2015.03.010

    Article  Google Scholar 

  • Cuayáhuitl H, Komatani K, Skantze G (2015) Introduction for speech and language for interactive robots. Comput Speech Lang 34:83–86. doi:10.1016/j.csl.2015.05.006

    Article  Google Scholar 

  • De Graaf MMA, Allouch SB, Klamer T (2015) Sharing a life with Harvey: exploring the acceptance of and relationship-building with a social robot. Comput Hum Behav 43:1–14. doi:10.1016/j.chb.2014.10.030

    Article  Google Scholar 

  • Dunne LE, Profita H, Zeagler C et al (2014) The social comfort of wearable technology and gestural interaction. In: Engineering in Medicine and Biology Society (EMBC), 2014 36th annual international conference of the IEEE, Chicago, IL, pp:4159–4162, 26–30 Aug 2014. doi:10.1109/EMBC.2014.6944540

  • Fortunati L, Esposito A, Lugano G (2015) Introduction to the special issue “Beyond industrial robotics: social robots entering public and domestic spheres”. Inf Soc 31:229–236. doi:10.1080/01972243.2015.1020195

    Article  Google Scholar 

  • Gustafson J, Lindberg N, Lundeberg M (1999) The August spoken dialogue system. Proceedings of the 6th European conference on speech and communication technology (EUROSPEECH’99), Budapest, Hungary, pp 1151–1154, 5–9 Sept 1999. http://www.isca-speech.org/archive/eurospeech_1999/e99_1151.html

  • Heerink M, Kröse B, Evers V, Wielinga B (2010) Assessing acceptance of assistive social agent technology by older adults: the almere model. Int J Soc Robot 2:361–375. doi:10.1007/s12369-010-0068-5

    Article  Google Scholar 

  • Hoenen M, Lübke KT, Pause BM (2016) Non-anthropomorphic robots as social entities on a neurophysiological level. Comput Hum Behav 57:182–186. doi:10.1016/j.chb.2015.12.034

    Article  Google Scholar 

  • Jeon M, Lee J-H (2013) The ecological AUI (Auditory User Interface) design and evaluation of user acceptance for various tasks on smartphones. In: Kurosa M (ed) Human-computer interaction modalities and techniques: 15th international conference, HCI International 2013, pp 49-58, Las Vegas, USA, 21–26 July. doi:10.1007/978-3-642-39330-3_6

    Google Scholar 

  • Kahn PH, Kanda T, Ishiguro H, Freier NG, Severson RL, Gill BT, Ruckert JH, Shen S (2012) “Robovie, you’ll have to go into the closet now”: children’s social and moral relationships with a humanoid robot. Dev Psychol 48(2):303–314. doi:10.1037/a0027033

    Article  Google Scholar 

  • Kanda T, Ishiguro H (2012) Human-robot interaction in social robotics. Edición: New. CRC Press, Boca Raton. doi: http://www.crcnetbase.com/doi/book/10.1201/b13004

    Google Scholar 

  • Kopp S, Wachsmuth I (2004) Synthesizing multimodal utterances for conversational agents. Comput Anim Virtual Worlds 15(1):39–52. doi:10.1002/cav.6

    Article  Google Scholar 

  • Leite I, Martinho C, Paiva A (2013) Social robots for long-term interaction: a Survey. Int J Soc Robot 5:291–308. doi:10.1007/s12369-013-0178-y

    Article  Google Scholar 

  • Looije R, Neerincx MA, Cnossen F (2010) Persuasive robotic assistant for health self-management of older adults: design and evaluation of social behaviors. Int J Hum Comput Stud 68:386–397. doi:10.1016/j.ijhcs.2009.08.007

    Article  Google Scholar 

  • Lourens T, van Berkel R, Barakova E (2010) Communicating emotions and mental states to robots in a real time parallel framework using Laban movement analysis. Robot Auton Syst 58:1256–1265. doi:10.1016/j.robot.2010.08.006

    Article  Google Scholar 

  • Luh D-B, Li EC, Kao Y-J (2015) The development of a companionship scale for artificial pets. Interact Comput 27:189–201. doi:10.1093/iwc/iwt055

    Article  Google Scholar 

  • Markowitz JA (ed) (2014) Robots that talk and listen: technology and social impact. Walter de Gruyter GmbH & Co. KG, Berlin; Boston. doi:http://dx.doi.org/10.1515/9781614514404

    Google Scholar 

  • Mathur MB, Reichling DB (2016) Navigating a social world with robot partners: a quantitative cartography of the Uncanny Valley. Cognition 146:22–32. doi:10.1016/j.cognition.2015.09.008

    Article  Google Scholar 

  • Matuszek C, FitzGerald N, Zettlemoyer L, Bo L, Fox D (2012) A joint model of language and perception for grounded attribute learning. In: Proceedings of the 29th international conference on machine learning (ICML’12), Edinburgh, Scotland, pp 1671–1678. https://homes.cs.washington.edu/~lsz/papers/mfzbf-icml12.pdf

  • Mavridis N (2015) A review of verbal and non-verbal human–robot interactive communication. 63. Robot Auton Syst 63:22–35. doi:10.1016/j.robot.2014.09.031

    Article  Google Scholar 

  • Molineux A, Cheverst K (2012) A survey of mobile vision recognition applications. In: Tiwary US, Siddiqui TJ (eds) Speech, image and language processing for human computer interaction. IGI Global, New York. doi:10.4018/978-1-4666-0954-9.ch014

  • Munteanu C, Jones M, Whittaker S, Oviatt S, Aylett M, Penn G, Brewster S, d’Alessandro N (2014) Designing speech and language interactions. In: CHI ‘14 extended abstracts on human factors in computing systems (CHI EA ‘14). ACM, New York, USA, pp 75–78. doi:10.1145/2559206.2559228

  • Nishida T, Nakazawa A, Ohmoto Y (eds) (2014) Conversational informatics: a data-intensive approach with emphasis on nonverbal communication. Springer, New York. doi:10.1007/978-4-431-55040-2

    Google Scholar 

  • Nomura T, Suzuki T, Kanda T, Kato K (2006) Measurement of negative attitudes toward robots. Interact Stud 7:437–454. doi:10.1075/is.7.3.14nom

    Article  Google Scholar 

  • Pearson Y, Borenstein J (2014) Creating “companions” for children: the ethics of designing esthetic features for robots. AI Soc 29:23–31. doi:10.1007/s00146-012-0431-1

    Article  Google Scholar 

  • Peca A, Simut R, Cao H-L, Vanderborght B (2015) Do infants perceive the social robot Keepon as a communicative partner? Infant Behav Dev. doi:10.1016/j.infbeh.2015.10.005

    Google Scholar 

  • Royakkers L, van Est R (2015) A literature review on new robotics: automation from love to war. Int J Soc Robot 7:549–570. doi:10.1007/s12369-015-0295-x

    Article  Google Scholar 

  • Sung J-Y, Guo L, Grinter RE, Christensen HI (2007) “My Roomba is Rambo”: intimate home appliances. In: Krumm J, Abowd GD, Seneviratne A, Strang T (eds) UbiComp 2007: ubiquitous computing. Springer, Berlin, pp 14–162. doi:10.1007/978-3-540-74853-3_9

  • Trappl R (ed) (2013) Your virtual butler: the making of. Springer, Berlin. doi:10.1007/978-3-642-37346-6

    Google Scholar 

  • Traum DR, Larsson S (2003) The information state approach to dialog management. In: Smith R, Kuppevelt J (eds) Current and new directions in discourse and dialog. Kluwer Academic Publishers, Dordrecht, pp 325–353. doi:10.1007/978-94-010-0019-2_15

    Google Scholar 

  • Turkle S (2012) Alone together: why we expect more from technology and less from each other. Basic Books, New York

    Google Scholar 

  • Wahlster W, Reithinger N, Blocher A (2001) Smartkom: Multimodal communication with a life-like character. In: Proceedings of the 7th European conference on speech communication and technology (Eurospeech 2001), Aalborg, Denmark, pp 1547–1550, 3–7 Sept 2001. http://www.isca-speech.org/archive/eurospeech_2001/e01_1547.html

  • Wilks Y (ed) (2010) Close engagements with artificial companions. Key social, psychological, ethical and design issues. John Benjamins Publishing Company, Amsterdam. doi:10.1075/nlp.8

    Google Scholar 

  • Wu Y-H, Wrobel J, Cornuet M, Kerhervé H, Damnée S, Rigaud A-S (2014) Acceptance of an assistive robot in older adults: a mixed-method study of human-robot interaction over a 1-month period in the Living Lab setting. Clin Interv Aging 9:801–811. doi:10.2147/CIA.S56435

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computing and Mathematics, Ulster University, Northern Ireland, UK

    Michael McTear

  2. ETSI Informática y Telecomunicación, University of Granada, Granada, Spain

    Zoraida Callejas

  3. Department of Computer Science, Universidad Carlos III de Madrid, Madrid, Spain

    David Griol

Authors
  1. Michael McTear
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zoraida Callejas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. David Griol
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Michael McTear .

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

McTear, M., Callejas, Z., Griol, D. (2016). Conversational Interfaces: Devices, Wearables, Virtual Agents, and Robots. In: The Conversational Interface. Springer, Cham. https://doi.org/10.1007/978-3-319-32967-3_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-32967-3_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-32965-9

  • Online ISBN: 978-3-319-32967-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation