{"pk":49980,"title":"CoRe: Cognitive Reasoning Framework for Zero-Shot Table Understanding and Reasoning","subtitle":null,"abstract":"While Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding, they still struggle with reasoning over table-based structured data, particularly in zero-shot settings. Tasks like question answering (QA), SQL generation, and numerical reasoning often fail due to insufficient task-specific training. To address these challenges, we propose CoRe (Cognitive Reasoning Framework for Structured Data), inspired by cognitive science principles of hierarchical and iterative reasoning. CoRe structures reasoning into multiple stages, allowing LLMs to better navigate the intricacies of table-based data. Evaluations using advanced LLMs, including Qwen-Plus, GPT-4o mini, and GLM-4-Plus, on datasets like HybridQA, BIRD, and DocMath-Eval show consistent performance improvements. CoRe outperforms zero-shot state-of-the-art (SOTA) on HybridQA and BIRD by 11.4% and 1.8% in Exact Match (EM) respectively, and achieves the best accuracy on DocMath-Eval's complong subset with 37.0%, approaching RAG-based SOTA. These results highlight CoRe's effectiveness as a robust framework for zero-shot reasoning over structured data.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"Artificial Intelligence; Cognitive architectures; Decision making; Language Comprehension; Natural Language Processing"}],"section":"Abstracts with Poster Presentation","is_remote":true,"remote_url":"https://escholarship.org/uc/item/6696229n","frozenauthors":[{"first_name":"Jiongfan","middle_name":"","last_name":"Chen","name_suffix":"","institution":"ETH Zurich","department":""},{"first_name":"Chengfeng","middle_name":"","last_name":"Chen","name_suffix":"","institution":"South China Normal University","department":""},{"first_name":"Haibo","middle_name":"","last_name":"Liu","name_suffix":"","institution":"Zhipu AI","department":""},{"first_name":"Fang","middle_name":"","last_name":"Wang","name_suffix":"","institution":"Zhipu AI","department":""},{"first_name":"Ying","middle_name":"","last_name":"Chen","name_suffix":"","institution":"Zhipu AI","department":""},{"first_name":"Haicong","middle_name":"","last_name":"Li","name_suffix":"","institution":"China Mobile Group Sichuan Co., Ltd.","department":""},{"first_name":"Bo","middle_name":"","last_name":"Zhang","name_suffix":"","institution":"China Mobile Group Sichuan Co., Ltd.","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2025-01-01T18:00:00Z","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/49980/galley/37942/download/"}]}