Skip to main content
SpringerLink
Log in

Emotion, Affect, and Personality

  • Chapter
  • First Online:
The Conversational Interface

Abstract

Affect is a key factor in human conversation. It allows us to fully understand each other, be socially competent, and show that we care. As such, in order to build conversational interfaces that display credible and expressive behaviors, we should endow them with the capability to recognize, adapt to, and render emotion. In this chapter, we explain the background to how emotional aspects and personality are conceptualized in artificial systems and outline the benefits of endowing the conversational interface with the ability to recognize and display emotions and personality.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.youtube.com/watch?v=aixduAt3fL0. Accessed February 26, 2016.

  2. 2.

    http://rafael-calvo.com/.

  3. 3.

    http://www.qub.ac.uk/schools/psy/Staff/Academic/Cowie/. Accessed February 26, 2016.

  4. 4.

    http://people.ict.usc.edu/~gratch/. Accessed February 2016.

  5. 5.

    https://www.cics.umass.edu/faculty/directory/hudlicka_eva. Accessed February 26, 2016.

  6. 6.

    http://www.ccs.neu.edu/people/faculty/member/marsella/. Accessed February 26, 2016.

  7. 7.

    http://gaips.inesc-id.pt/~apaiva/Ana_Paiva_Site_2/Home.html. Accessed February 26, 2016.

  8. 8.

    http://www.ofai.at/~paolo.petta/. Accessed February 26, 2016.

  9. 9.

    http://web.media.mit.edu/~picard/. Accessed February 26, 2016.

  10. 10.

    http://www.affective-sciences.org/user/scherer. Accessed February 26, 2016.

  11. 11.

    http://www.dfki.de/~schroed/index.html. Accessed February 26, 2016.

  12. 12.

    http://www.ofai.at/~robert.trappl/. Accessed February 26, 2016.

References

  • Beale R, Creed C (2009) Affective interaction: how emotional agents affect users. Int J Hum-Comput Stud 67:755–776. doi:10.1016/j.ijhcs.2009.05.001

    Article  Google Scholar 

  • Bickmore TW, Puskar K, Schlenk EA, Pfeifer LM, Sereika SM (2010) Maintaining reality: relational agents for antipsychotic medication adherence. Interact Comput 22(4):276–288. doi:10.1016/j.intcom.2010.02.001

    Article  Google Scholar 

  • Boehner K, DePaula R, Dourish P, Sengers P (2007) How emotion is made and measured. Int J Hum-Comput 65(4):275–291. doi:10.1016/j.ijhcs.2006.11.016

    Article  Google Scholar 

  • Bui TH, Poel M, Nijholt A, Zwiers J (2009) A tractable hybrid DDN–POMDP approach to affective dialogue modeling for probabilistic frame-based dialogue systems. Nat Lang Eng 15(2):273–307. doi:10.1017/S1351324908005032

    Article  Google Scholar 

  • Bui TH, Zwiers J, Poel M, Nijholt A (2010) Affective dialogue management using factored POMDPs. In: Babuška R, Groen FCA (eds) Interactive collaborative information systems: studies in computational intelligence. Springer, Berlin, pp 207–236. doi:10.1007/978-3-642-11688-9_8

    Google Scholar 

  • Callejas Z, López-Cózar R (2008) Influence of contextual information in emotion annotation for spoken dialogue systems. Speech Commun 50(5):416–433. doi:10.1016/j.specom.2008.01.001

    Article  Google Scholar 

  • Callejas Z, Griol D, López-Cózar R (2011) Predicting user mental states in spoken dialogue systems. EURASIP J Adv Signal Process 1:6. doi:10.1186/1687-6180-2011-6

    Article  Google Scholar 

  • Cowie R, Douglas-Cowie E, Savvidou S, McMahon E, Sawey M, Schröder M (2000) FEELTRACE: an instrument for recording perceived emotion in real time. In: Proceedings of the International Speech Communication Association (ISCA) workshop on speech and emotion. Newcastle, Northern Ireland, pp 19–24

    Google Scholar 

  • Dybala P, Ptaszynski M, Rzepka R, Araki K (2009) Activating humans with humor—a dialogue system that users want to interact with. IEICE T Inf Syst E92-D(12):2394–2401. doi:10.1587/transinf.E92.D.2394

    Google Scholar 

  • Ekman P (1999) Basic emotions. In: Dalgleish T, Power MJ (eds) Handbook of cognition and emotion. Wiley, Chichester, pp 45–60. doi:10.1002/0470013494.ch3

    Google Scholar 

  • Fox E (2008) Emotion science: cognitive and neuroscientific approaches to understanding human emotions. Palgrave Macmillan, Basingstoke

    Google Scholar 

  • Gratch J, Marsella S (eds) (2013) Social emotions in nature and artifact. Oxford University Press, Oxford. doi:10.1093/acprof:oso/9780195387643.001.0001

    Google Scholar 

  • Gratch J, Marsella S, Petta P (2009) Modeling the cognitive antecedents and consequences of emotion. Cogn Syst Res 10(1):1–5. doi:10.1016/j.cogsys.2008.06.001

    Article  Google Scholar 

  • Griol D, Molina JM, Callejas Z (2014) Modeling the user state for context-aware spoken interaction in ambient assisted living. Appl Intell 40(4):749–771. doi:10.1007/s10489-013-0503-z

    Article  Google Scholar 

  • Hudlicka E (2014) Affective BICA: challenges and open questions. Biol Inspired Cogn Archit 7:98–125. doi:10.1016/j.bica.2013.11.002

    Google Scholar 

  • Hwang J, Park T, Hwang W (2013) The effects of overall robot shape on the emotions invoked in users and the perceived personalities of robot. Appl Ergon 44(3):459–471. doi:10.1016/j.apergo.2012.10.010

    Article  MathSciNet  Google Scholar 

  • Iurgel IA, Marcos AF (2007) Employing personality-rich virtual persons. New tools required. Comput Graph 31(6):827–836. doi:10.1016/j.cag.2007.08.001

    Article  Google Scholar 

  • Johnson G (2009) Emotion, theories of. Internet Encycl Philos http://www.iep.utm.edu/emotion/

  • Kang S-H, Gratch J (2014) Exploring users’ social responses to computer counseling interviewers’ behavior. Comput Hum Behav 34:120–130. doi:10.1016/j.chb.2014.01.006

    Article  Google Scholar 

  • Lee KM, Peng W, Jin S-A, Yan C (2006) Can robots manifest personality? An empirical test of personality recognition, social responses, and social presence in human-robot interaction. J Commun 56(4):754–772. doi:10.1111/j.1460-2466.2006.00318.x

    Article  Google Scholar 

  • Leite I, Pereira A, Mascarenhas S, Martinho C, Prada R, Paiva A (2013) The influence of empathy in human–robot relations. Int J Hum-Comput St 71(3):250–260. doi:10.1016/j.ijhcs.2012.09.005

    Article  Google Scholar 

  • Looije R, Neerincx MA, Cnossen F (2010) Persuasive robotic assistant for health self-management of older adults: design and evaluation of social behaviors. Int J Hum-Comput St 68(6):386–397. doi:10.1016/j.ijhcs.2009.08.007

    Article  Google Scholar 

  • Mairesse F, Walker MA (2010) Towards personality-based user adaptation: psychologically informed stylistic language generation. User Model User-Adap 20(3):227–278. doi:10.1007/s11257-010-9076-2

    Article  Google Scholar 

  • Mairesse F, Walker MA (2011) Controlling user perceptions of linguistic style: trainable generation of personality traits. Comput Linguist 37(3):455–488. doi:10.1162/COLI_a_00063

    Article  Google Scholar 

  • Marinetti C, Moore P, Lucas P, Parkinson B (2011) Emotions in social interactions: unfolding emotional experience. In: Cowie R, Pelachaud C, Petta P (eds) Emotion-oriented systems, cognitive technologies. Springer, Berlin, pp 31–46. doi:10.1007/978-3-642-15184-2_3

    Google Scholar 

  • Marsella S, Gratch J (2014) Computationally modeling human emotion. Commun ACM 57(12):56–67, doi:10.1145/2631912

    Google Scholar 

  • Marsella S, Gratch J, Petta P (2010) Computational models of emotion. In: Scherer KR, Bänziger T, Roesch EB (eds) Blueprint for affective computing: a source book. Oxford University Press, Oxford, pp 21–41

    Google Scholar 

  • McCrae RR, John OP (1992) An introduction to the five-factor model and its applications. J Pers 60(2):175–215. doi:10.1111/j.1467-6494.1992.tb00970.x

    Article  Google Scholar 

  • McQuiggan SW, Lester JC (2007) Modeling and evaluating empathy in embodied companion agents. Int J Hum-Comput St 65(4):348–360. doi:10.1016/j.ijhcs.2006.11.015

    Article  Google Scholar 

  • Mehrabian A (1997) Comparison of the PAD and PANAS as models for describing emotions and for differentiating anxiety from depression. J Psychopathol Behav 19(4):331–357. doi:10.1007/BF02229025

    Article  Google Scholar 

  • Mohammadi G, Vinciarelli A (2012) Automatic personality perception: prediction of trait attribution based on prosodic features. IEEE T Affect Comput 3(3):273–284. doi:10.1109/T-AFFC.2012.5

    Article  Google Scholar 

  • Moors A, Ellsworth P, Scherer KR, Frijda NH (2013) Appraisal theories of emotion: state of the art and future development. Emot Rev 5(2):119–124. doi:10.1177/1754073912468165

    Article  Google Scholar 

  • Moridis CN, Economides AA (2012) Affective learning: empathetic agents with emotional facial and tone of voice expressions. IEEE T Affect Comput 3(3):260–272. doi:10.1109/T-AFFC.2012.6

    Article  Google Scholar 

  • Nass C, Lee KM (2000) Does computer-generated speech manifest personality? An experimental test of similarity-attraction. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI’00). The Hague, Netherlands, 1–6 April 2000:329–336. doi:10.1145/332040.332452

  • Neff M, Wang Y, Abbott R, Walker M, (2010) Evaluating the effect of gesture and language on personality perception in conversational agents. In: Allbeck J, Badler N, Bickmore T, Pelachaud C, Safonova A (eds) Intelligent virtual agents 6356. Springer, Berlin, pp 222–235. doi:10.1007/978-3-642-15892-6_24

    Google Scholar 

  • Ortigosa A, Carro RM, Quiroga JI (2014) Predicting user personality by mining social interactions in facebook. J Comput Syst Sci 80(1):57–71. doi:10.1016/j.jcss.2013.03.008

    Article  MathSciNet  Google Scholar 

  • Ortony A, Clore GL, Collins A (1990) The cognitive structure of emotions. Cambridge University Press, Cambridge

    Google Scholar 

  • Pekrun R, Cusack A, Murayama K, Elliot AJ, Thomas K (2014) The power of anticipated feedback: effects on students’ achievement goals and achievement emotions. Learn Instr 29:115–124. doi:10.1016/j.learninstruc.2013.09.002

    Article  Google Scholar 

  • Picard RW (1997) Affective computing. The MIT Press, Cambridge

    Book  Google Scholar 

  • Pittermann J, Pittermann A, Minker W (2009) Handling emotions in human-computer dialogues. Springer Science & Business Media, Netherlands. doi:10.1007/978-90-481-3129-7

    Google Scholar 

  • Plutchik R (2003) Emotions and life: perspectives from psychology, biology, and evolution. American Psychological Association, Washington, DC

    Google Scholar 

  • Polzehl T (2015) Personality in speech: assessment and automatic classification. Springer, New York. doi:10.1007/978-3-319-09516-5

    Google Scholar 

  • Reisenzein R, Hudlicka E, Dastani M, Gratch J, Hindriks KV, Lorini E, Meyer J-JC (2013) Computational modeling of emotion: toward improving the inter- and intradisciplinary exchange. IEEE T Affect Comput 4(3):246–266. doi:10.1109/t-affc.2013.14

    Article  Google Scholar 

  • Sander D, Scherer KR (eds) (2009) The Oxford companion to emotion and the affective sciences. Oxford University Press, Oxford

    Google Scholar 

  • Scherer K (2005) What are emotions? And how can they be measured? Soc Sci Inform 44(4):695–729. doi:10.1177/0539018405058216

    Article  Google Scholar 

  • Schmitt A, Ultes S (2015) Interaction quality: assessing the quality of ongoing spoken dialog interaction by experts—and how it relates to user satisfaction. Speech Commun 74:12–36. doi:10.1016/j.specom.2015.06.003

    Article  Google Scholar 

  • Schonbrodt FD, Asendorpf JB (2011) The challenge of constructing psychologically believable agents. J Media Psychol-GER 23(2):100–107. doi:10.1027/1864-1105/a000040

    Article  Google Scholar 

  • Schröder M, Bevacqua E, Cowie R, Eyben F, Gunes H, Heylen D, ter Maat M, McKeown G, Pammi S, Pantic M, Pelachaud C, Schuller B, de Sevin E, Valstar M, Wöllmer M (2012) Building autonomous sensitive artificial listeners. IEEE T Affect Comput 3(2):165–183. doi:10.1109/T-AFFC.2011.34

    Article  Google Scholar 

  • Schuller B, Batliner A (2013) Computational paralinguistics: emotion, affect and personality in speech and language processing. Wiley, Chichester. doi:10.1002/9781118706664

    Google Scholar 

  • Schuller B, Steidl S, Batliner A, Nöth E, Vinciarelli A, Burkhardt F, van Son R, Weninger F, Eyben F, Bocklet T, Mohammadi G, Weiss B (2012) The INTERSPEECH 2012 speaker trait challenge. In: Proceedings of the 13th annual conference of the international speech communication association (Interspeech 2012), Portland, 9–13 Sept 2012. http://www.isca-speech.org/archive/interspeech_2012/i12_0254.html

  • Sellers M (2013) Toward a comprehensive theory of emotion for biological and artificial agents. Biol Inspired Cogn Archit 4:3–26. doi:10.1016/j.bica.2013.02.002

    MathSciNet  Google Scholar 

  • Sun X, Lichtenauer J, Valstar M, Nijholt A, Pantic M (2011) A multimodal database for mimicry analysis. In: D’Mello S, Graesser A, Schuller B, Martin J-C (eds) Affective computing and intelligent interaction, Lecture Notes in Computer Science. Springer, Berlin, pp 367–376. doi:10.1007/978-3-642-24600-5_40

    Google Scholar 

  • Trappl R, Petta P, Payr S (eds) (2002) Emotions in humans and artifacts. MIT Press, Cambridge

    MATH  Google Scholar 

  • Vannini N, Enz S, Sapouna M, Wolke D, Watson S, Woods S, Dautenhahn K, Hall L, Paiva A, André E, Aylett R, Schneider W (2011) “FearNot!”: a computer-based anti-bullying-programme designed to foster peer interventions. Eur J Psychol Educ 26(1):21–44. doi:10.1007/s10212-010-0035-4

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computing and Mathematics, Ulster University, Northern Ireland, UK

    Michael McTear

  2. ETSI Informática y Telecomunicación, University of Granada, Granada, Spain

    Zoraida Callejas

  3. Department of Computer Science, Universidad Carlos III de Madrid, Madrid, Spain

    David Griol

Authors
  1. Michael McTear
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zoraida Callejas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. David Griol
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Michael McTear .

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

McTear, M., Callejas, Z., Griol, D. (2016). Emotion, Affect, and Personality. In: The Conversational Interface. Springer, Cham. https://doi.org/10.1007/978-3-319-32967-3_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-32967-3_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-32965-9

  • Online ISBN: 978-3-319-32967-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation