{"pk":21668,"title":"Speakers align both their gestures and words not only to establish but also to maintain reference to create shared labels for novel objects in interaction","subtitle":null,"abstract":"When we communicate with others, we often repeat aspects of each other's communicative behavior such as sentence structures and words. Such behavioral alignment has been mostly studied for speech or text. Yet, language use is mostly multimodal, flexibly using speech and gestures to convey messages. Here, we explore the use of alignment in speech (words) and co-speech gestures (iconic gestures) in a referential communication task aimed at finding labels for novel objects in interaction. In particular, we investigate how people flexibly use lexical and gestural alignment to create shared labels for novel objects and whether alignment in speech and gesture are related over time. The present study shows that interlocutors establish shared labels multimodally, and alignment in words and iconic gestures are used throughout the interaction. We also show that the amount of lexical alignment positively associates with the amount of gestural alignment over time, suggesting a close relationship between alignment in the vocal and manual modalities.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"Linguistics; Discourse; Interactive behavior; Language Production; Gesture analysis"}],"section":"Papers with Poster Presentation","is_remote":true,"remote_url":"https://escholarship.org/uc/item/66x7x5hz","frozenauthors":[{"first_name":"Sho","middle_name":"","last_name":"Akamine","name_suffix":"","institution":"Max Planck Institute for Psycholinguistics","department":""},{"first_name":"Esam","middle_name":"","last_name":"Ghaleb","name_suffix":"","institution":"University of Amsterdam","department":""},{"first_name":"Marlou","middle_name":"","last_name":"Rasenberg","name_suffix":"","institution":"Meertens Institute","department":""},{"first_name":"Raquel","middle_name":"","last_name":"Fernandez","name_suffix":"","institution":"University of Amsterdam","department":""},{"first_name":"Antje","middle_name":"","last_name":"Meyer","name_suffix":"","institution":"Max Planck Institute for Psycholinguistics","department":""},{"first_name":"Asli","middle_name":"","last_name":"Ōzyürek","name_suffix":"","institution":"Max Planck Institute","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2024-01-01T18:00:00Z","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/21668/galley/11267/download/"},{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/21668/galley/14576/download/"},{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/21668/galley/22046/download/"}]}