{"pk":49438,"title":"Cognitive-Inspired Hierarchical Attention Fusion With Visual and Textual for Cross-Domain Sequential Recommendation","subtitle":null,"abstract":"Cross-Domain Sequential Recommendation (CDSR) predicts user behavior by leveraging historical interactions across multiple domains, focusing on modeling cross-domain preferences through intra- and inter-sequence item relationships. Inspired by human cognitive processes, we propose Hierarchical Attention Fusion of Visual and Textual Representations (HAF-VT), a novel approach integrating visual and textual data to enhance cognitive modeling. Using the frozen CLIP model, we generate image and text embeddings, enriching item representations with multimodal data. A hierarchical attention mechanism jointly learns single-domain and cross-domain preferences, mimicking human information integration. Evaluated on four e-commerce datasets, HAF-VT outperforms existing methods in capturing cross-domain user interests, bridging cognitive principles with computational models and highlighting the role of multimodal data in sequential decision-making.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"Artificial Intelligence; Computer Science; Machine learning; Computational neuroscience"}],"section":"Papers with Poster Presentation","is_remote":true,"remote_url":"https://escholarship.org/uc/item/8n60x457","frozenauthors":[{"first_name":"Wangyu","middle_name":"","last_name":"Wu","name_suffix":"","institution":"Xi'an Jiaotong-Liverpool University","department":""},{"first_name":"Zhenhong","middle_name":"","last_name":"Chen","name_suffix":"","institution":"Microsoft","department":""},{"first_name":"Siqi","middle_name":"","last_name":"Song","name_suffix":"","institution":"Xi'an Jiaotong-Liverpool University","department":""},{"first_name":"Xianglin","middle_name":"","last_name":"Qiu","name_suffix":"","institution":"Xi'an Jiaotong-Liverpool University","department":""},{"first_name":"Xiaowei","middle_name":"","last_name":"Huang","name_suffix":"","institution":"The University of Liverpool","department":""},{"first_name":"Fei","middle_name":"","last_name":"Ma","name_suffix":"","institution":"Xi'an Jiaotong-Liverpool University","department":""},{"first_name":"Jimin","middle_name":"","last_name":"Xiao","name_suffix":"","institution":"Xi'an Jiaotong-Liverpool University","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2025-01-01T18:00:00Z","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/49438/galley/37400/download/"}]}