{"pk":49454,"title":"Common Ground Building through Generative Cognitive Modules: Examining the Roles of Initial Perception, Imaging and Captioning","subtitle":null,"abstract":"To advance our understanding of referential communication and common ground formation, this study presents a novel generative cognitive model that integrates deep neural networks for visual perception, image generation, and language captioning. Using the Tangram Naming Task (TNT), we simulate the sender–receiver interaction with modular processes replicating holistic cognitive strategies. Through controlled simulation experiments, we reveal that language generation plays a more crucial role than visual perception in establishing common ground, while intermediate image generation enhances linguistic diversity—a key aspect of natural communication. Our results bridge cognitive modeling and large generative models, demonstrating how internal cognitive dynamics can be visualized and quantitatively evaluated. This study contributes to the growing field of cognitive-inspired human–AI communication and provides a blueprint for grounding-rich simulations in collaborative tasks.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"Linguistics; Psychology; Cognitive architectures; Language Production; Computational Modeling"}],"section":"Papers with Poster Presentation","is_remote":true,"remote_url":"https://escholarship.org/uc/item/6mc5w78f","frozenauthors":[{"first_name":"Ryunosuke","middle_name":"","last_name":"Baba","name_suffix":"","institution":"Shizuoka university","department":""},{"first_name":"Junya","middle_name":"","last_name":"Morita","name_suffix":"","institution":"Shizuoka University","department":""},{"first_name":"Takeru","middle_name":"","last_name":"Amaya","name_suffix":"","institution":"Shizuoka university","department":""},{"first_name":"Ryuichiro","middle_name":"","last_name":"Higashinaka","name_suffix":"","institution":"Nippon Telegraph and Telephone Corporation","department":""},{"first_name":"Yugo","middle_name":"","last_name":"Takeuchi","name_suffix":"","institution":"Shizuoka University","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2025-01-01T18:00:00Z","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/49454/galley/37416/download/"}]}