{"type":"ScholarlyArticle","title":"Developing an Integrated Model of Speech Entrainment","authors":[{"name":"Rivka Levitan","slug":"rivka-levitan","given":"Rivka","family":"Levitan","affiliation":"Department of Computer and Information Science , Brooklyn College , NY , USA; Computer Science Department , Linguistics Department , CUNY Graduate Center , NY , USA"}],"abstract":"Entrainment, the phenomenon of conversational partners’ speech becoming more similar to each other, is generally accepted to be an important aspect of human-human and human-machine communication. However, there is a gap between accepted psycholinguistic models of entrainment and the body of empirical findings, which includes a large number of unexplained negative results. Existing research does not provide insights specific enough to guide the implementation of entraining spoken dialogue systems or the interpretation of entrainment as a measure of quality. A more integrated model of entrainment is proposed, which looks for consistent explanations of entrainment behavior on specific features and how they interact with speaker, session, and utterance characteristics.","doi":"10.24963/ijcai.2020/727","url":"https://ijcai.org/proceedings/2020/727","pdf":"https://ijcai.org/proceedings/2020/0727.pdf","markdown":"https://ijcai.org/proceedings/2020/727.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/727","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Early Career","track":"Early Career","number":727,"pages":{"first":5159,"last":5163},"keywords":["Natural Language Processing: Speech","Humans and AI: Human-Computer Interaction","Natural Language Processing: Dialogue"],"videos":[],"references":[{"position":1,"raw":"[Boersma and Weenink, 2012] Paul Boersma and David Weenink. Praat: doing phonetics by computer [computer program]., 2012. Version 5.3.23, retrieved 21 August 2012 from http://www.praat.org.","title":"Praat: doing phonetics by computer [computer program","authors":"Weenink Boersma, Paul Boersma, David Weenink","year":"2012","venue":null,"doi":null,"url":"http://www.praat.org","internal_url":null},{"position":2,"raw":"[Chartrand and Bargh, 1999] Tanya L. Chartrand and John A. Bargh. The chameleon effect: The Perception- Behavior Link and Social Interaction. Journal of Personality and Social Psychology, 76(6):893-910, 1999.","title":"The chameleon effect: The Perception-Behavior Link and Social Interaction","authors":"Tanya L Chartrand, John A Bargh","year":"1999","venue":"Journal of Personality and Social Psychology","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Cohen Priva and Sanker, 2020] Uriel Cohen Priva and Chelsea Sanker. Natural leaders: Some interlocutors elicit greater convergence across conversations and across characteristics. 2020.","title":"Uriel Cohen Priva and Chelsea Sanker. Natural leaders: Some interlocutors elicit greater convergence across conversations and across characteristics","authors":"Cohen Priva, Sanker","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Danescu-Niculescu-Mizil et al., 2012] Cristian Danescu- Niculescu-Mizil, Lillian Lee, Bo Pang, and Jon Kleinberg. Echoes of power: language effects and power differences in social interaction. In Proceedings of WWW, 2012.","title":"Echoes of power: language effects and power differences in social interaction","authors":"Cristian Danescu-Niculescu-Mizil, Lillian Lee, Bo Pang, Jon Kleinberg","year":"2012","venue":"Proceedings of WWW","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Giles et al., 1991] Howard Giles, Nikolas Coupland, and Justine Coupland. Accommodation theory: Communica- tion, context, and consequence. In Contexts of accommo- dation: Developments in applied sociolinguistics, pages 1-68. 1991.","title":"Accommodation theory: Communication, context, and consequence","authors":"Howard Giles, Nikolas Coupland, Justine Coupland","year":"1991","venue":"Contexts of accommodation: Developments in applied sociolinguistics","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Gravano et al., 2014] Agustín Gravano, Štefan Beňuš, Rivka Levitan, and Julia Hirschberg. Three ToBI-based measures of prosodic entrainment and their correlations with speaker engagement. In Spoken Language Tech- nology (SLT), 2014 IEEE Workshop on, pages 578-583, 2014.","title":"Three ToBI-based measures of prosodic entrainment and their correlations with speaker engagement","authors":"Gravano","year":"2014","venue":"Spoken Language Technology (SLT), 2014 IEEE Workshop on","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Gravano, 2009] Agustín Gravano. Turn-taking and affir- mative cue words in task-oriented dialogue. PhD thesis, Columbia University, 2009.","title":"Agustín Gravano. Turn-taking and affirmative cue words in task-oriented dialogue","authors":"Gravano","year":"2009","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Heldner et al., 2010] Mattias Heldner, Jens Edlund, and Ju- lia Bell Hirschberg. Pitch similarity in the vicinity of backchannels. In Proceedings of Interspeech, 2010.","title":"Pitch similarity in the vicinity of backchannels","authors":"Mattias Heldner, Jens Edlund, Julia Bell Hirschberg","year":"2010","venue":"Proceedings of Interspeech","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Hu et al., 2014] Zhichao Hu, Gabrielle Halberg, Car- olynn R Jimenez, and Marilyn A Walker. Entrainment in pedestrian direction giving: How many kinds of entrain- ment? In Proceedings of 5th International Workshop on Spoken Dialog System, 2014.","title":"Entrainment in pedestrian direction giving: How many kinds of entrainment?","authors":"Zhichao Hu, Gabrielle Halberg, Carolynn R Jimenez, Marilyn A Walker","year":"2014","venue":"Proceedings of 5th International Workshop on Spoken Dialog System","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Ireland et al., 2011] Molly E. Ireland, Richard B. Slatcher, Paul W. Eastwick, Lauren E. Scissors, Eli J. Finkel, and James W. Pennebaker. Language Style Matching Predicts Relationship Initiation and Stability. Psychological Sci- ence, 22(1):39-44, 2011.","title":"Language Style Matching Predicts Relationship Initiation and Stability","authors":"Molly E Ireland, Richard B Slatcher, Paul W Eastwick, Lauren E Scissors, Eli J Finkel, James W Pennebaker","year":"2011","venue":"Psychological Science","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Lakoff, 1972] Robin Tolmach Lakoff. Language and woman's place. Cambridge Univ Press, 1972.","title":"Language and woman's place","authors":"Robin Tolmach Lakoff, Lakoff","year":"1972","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Lee et al., 2010] Chi-Chun Lee, Matthew Black, Athana- sios Katsamanis, Adam Lammert, Brian Baucom, An- drew Christensen, Panayiotis G. Georgiou, and Shrikanth Narayanan. Quantification of prosodic entrainment in af- fective spontaneous spoken interactions of married cou- ples. In Proceedings of Interspeech, 2010.","title":"Quantification of prosodic entrainment in affective spontaneous spoken interactions of married couples","authors":"Lee","year":"2010","venue":"Proceedings of Interspeech","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Lehnert-LeHouillier et al., 2020] Heike Lehnert- LeHouillier, Susana Terrazas, Steven Sandoval, and Rachel Boren. The relationship between prosodic ability and conversational prosodic entrainment. In Proc. 10th International Conference on Speech Prosody 2020, pages 769-773, 2020.","title":"The relationship between prosodic ability and conversational prosodic entrainment","authors":"Heike Lehnert-Lehouillier, Susana Terrazas, Steven Sandoval, Rachel Boren","year":"2020","venue":"Proc. 10th International Conference on Speech Prosody 2020","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Levitan and Hirschberg, 2011] Rivka Levitan and Julia Hirschberg. Measuring acoustic-prosodic entrainment with respect to multiple levels and dimensions. In Inter- speech 2011, pages 3081-3084, 2011.","title":"Measuring acoustic-prosodic entrainment with respect to multiple levels and dimensions","authors":"Hirschberg Levitan, Rivka Levitan, Julia Hirschberg","year":"2011","venue":"Interspeech 2011","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Levitan et al., 2011] Rivka Levitan, Agustín Gravano, and Julia Hirschberg. Entrainment in Speech Preceding Backchannels. In ACL HLT, pages 113-117, 2011.","title":"Entrainment in Speech Preceding Backchannels","authors":"Rivka Levitan, Agustín Gravano, Julia Hirschberg","year":"2011","venue":"ACL HLT","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Levitan et al., 2012] Rivka Levitan, Laura Willson, Agustín Gravano, Štefan Beňuš, Julia Hirschberg, and Ani Nenkova. Acoustic-Prosodic Entrainment and Social Be- havior. In NAACL HLT, pages 11-19, 2012.","title":"Acoustic-Prosodic Entrainment and Social Behavior","authors":"Rivka Levitan, Laura Willson, Agustín Gravano, Štefan Beňuš, Julia Hirschberg, Ani Nenkova","year":"2012","venue":"NAACL HLT","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Levitan et al., 2015] Rivka Levitan, Stefan Benus, Agustin Gravano, and Julia Hirschberg. Entrainment and turn- taking in human-human dialogue. In AAAI 2015 Spring Symposium on Turn-taking and Coordination in Human- Machine Interaction, 2015.","title":"Entrainment and turntaking in human-human dialogue","authors":"Rivka Levitan, Stefan Benus, Agustin Gravano, Julia Hirschberg","year":"2015","venue":"AAAI 2015 Spring Symposium on Turn-taking and Coordination in Human-Machine Interaction","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Levitan et al., 2016] Rivka Levitan, Stefan Benus, Ramiro Gálvez, Agustín Gravano, Florencia Savoretti, Marián Trnka, Andreas Weise, and Julia Hirschberg. Imple- menting acoustic-prosodic entrainment in a conversational avatar. pages 1166-1170, 09 2016.","title":"Implementing acoustic-prosodic entrainment in a conversational avatar","authors":"Rivka Levitan, Stefan Benus, Ramiro Gálvez, Agustín Gravano, Florencia Savoretti, Marián Trnka, Andreas Weise, Julia Hirschberg","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Levitan, 2014] Rivka Levitan. Acoustic-Prosodic Entrain- ment in Human-Human and Human-Computer Dialogue.","title":"Acoustic-Prosodic Entrainment in Human-Human and Human-Computer Dialogue","authors":"Rivka Levitan","year":null,"venue":null,"doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Lopes et al., 2013] José Lopes, Maxine Eskenazi, and Is- abel Trancoso. Automated two-way entrainment to im- prove spoken dialog system performance. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE In- ternational Conference on, pages 8372-8376. IEEE, 2013.","title":"José Lopes, Maxine Eskenazi, and Isabel Trancoso. Automated two-way entrainment to improve spoken dialog system performance","authors":"Lopes","year":"2013","venue":"Acoustics, Speech and Signal Processing (ICASSP)","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Natale, 1975] Michael Natale. Convergence of mean vocal intensity in dyadic communication as a function of social desirability. Journal of Personality and Social Psychology, 32(5):790-804, 1975.","title":"Convergence of mean vocal intensity in dyadic communication as a function of social desirability","authors":"Michael Natale","year":"1975","venue":"Journal of Personality and Social Psychology","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Nenkova et al., 2008] Ani Nenkova, Agustín Gravano, and Julia Hirschberg. High Frequency Word Entrainment in Spoken Dialogue. In ACL HLT, pages 169-172, 2008.","title":"High Frequency Word Entrainment in Spoken Dialogue","authors":"Nenkova","year":"2008","venue":"ACL HLT","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Pardo, 2006] Jennifer S. Pardo. On phonetic convergence during conversational interaction. The Journal of the Acoustical Society of America, 119(4):2382-2393, 2006.","title":"On phonetic convergence during conversational interaction","authors":"Jennifer S Pardo","year":"2006","venue":"The Journal of the Acoustical Society of America","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Pickering and Garrod, 2004] Martin J. Pickering and Simon Garrod. Toward a mechanistic psychology of dialogue. The Behavioral and brain sciences, 27(2):169-190, 2004.","title":"Toward a mechanistic psychology of dialogue","authors":"Martin J Pickering, Simon Garrod","year":"2004","venue":"The Behavioral and brain sciences","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Reichel et al., 2018] Uwe D. Reichel, Katalin Mády, and Jennifer Cole. Prosodic entrainment in dialog acts. ArXiv, abs/1810.12646, 2018.","title":"Prosodic entrainment in dialog acts","authors":"D Uwe, Katalin Reichel, Jennifer Mády, Cole","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Thomason et al., 2013] Jesse Thomason, Huy V Nguyen, and Diane Litman. Prosodic entrainment and tutoring di- alogue success. In Artificial Intelligence in Education, pages 750-753. Springer, 2013.","title":"Prosodic entrainment and tutoring dialogue success","authors":"Jesse Thomason, Diane Huy V Nguyen, Litman","year":"2013","venue":"Artificial Intelligence in Education","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Weise and Levitan, 2018] Andreas Weise and Rivka Levi- tan. Looking for structure in lexical and acoustic-prosodic entrainment behaviors. In Proceedings of NAACL, 2018.","title":"Looking for structure in lexical and acoustic-prosodic entrainment behaviors","authors":"Levitan Weise, Andreas Weise, Rivka Levitan","year":"2018","venue":"Proceedings of NAACL","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Weise et al., 2019] Andreas Weise, Sarah Ita Levitan, Julia Hirschberg, and Rivka Levitan. Individual differences in acoustic-prosodic entrainment in spoken dialogue. Speech Communication, 115:78-87, 2019.","title":"Individual differences in acoustic-prosodic entrainment in spoken dialogue","authors":"Andreas Weise, Sarah Ita Levitan, Julia Hirschberg, Rivka Levitan","year":"2019","venue":"Speech Communication","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}