{"pk":24407,"title":"Multi-Agent Communication With Multi-Modal Information Fusion","subtitle":null,"abstract":"Many recent works in the field of multi-agent reinforcement\nlearning via communication focus on learning what messages\nto send, when to send, and whom to address such messages.\nThose works indicate that communication is useful for higher\ncumulative reward or task success. However, one important limitation is that most of them ignore the importance of enforcing\nagents' ability to understand the received information. In this\npaper, we notice that observation and communication signals\nare from separate information sources. Thus, we enhance the\ncommunicating agents with the capability to integrate crucial\ninformation from different sources. Specifically, we propose a\nmulti-modal communication method, which modulates agents'\nobservation and communication signals as different modalities\nand performs multi-modal fusion to allow knowledge to transfer\nacross different modalities. We evaluate the proposed method\non a diverse set of cooperative multi-agent tasks with several\nstate-of-the-art algorithms. Results demonstrate the effectiveness of our method in incorporating knowledge and gaining a\ndeeper understanding from various information sources.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"Artificial Intelligence; Machine learning; Agent-based Modeling; Neural Networks"}],"section":"Papers with Poster Presentation","is_remote":true,"remote_url":"https://escholarship.org/uc/item/24w3654z","frozenauthors":[{"first_name":"Han","middle_name":"","last_name":"Wang","name_suffix":"","institution":"Xidian University","department":""},{"first_name":"Yufeng","middle_name":"","last_name":"Xie","name_suffix":"","institution":"Xidian University","department":""},{"first_name":"BingCheng","middle_name":"","last_name":"He","name_suffix":"","institution":"Xidian University","department":""},{"first_name":"Prof. Qingshan","middle_name":"","last_name":"Li","name_suffix":"","institution":"Xidian University","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2024-01-01T19:00:00+01:00","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/24407/galley/14004/download/"},{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/24407/galley/21388/download/"}]}