{"pk":21318,"title":"In-context learning in natural and artificial intelligence","subtitle":null,"abstract":"In-context learning refers to the ability of a neural network to learn from information presented in its context. While traditional learning in neural networks requires adjusting network weights for every new task, in-context learning operates purely by updating internal activations without needing any updates to network weights. The emergence of this ability in large language models has led to a paradigm shift in machine learning and has forced researchers to reconceptualize how they think about learning in neural networks. Looking beyond language models, we can find in-context learning in many computational models relevant to cognitive science, including those that emerge from meta-learning.","language":"eng","license":{"name":"","short_name":"","text":null,"url":""},"keywords":[{"word":"Artificial Intelligence; Cognitive Neuroscience; Computer Science; Linguistics; Psychology; Machine learning; Computational Modeling; Large Language Models; Neural Networks"}],"section":"Workshops","is_remote":true,"remote_url":"https://escholarship.org/uc/item/4mz2d084","frozenauthors":[{"first_name":"Akshay Kumar","middle_name":"","last_name":"Jagadish","name_suffix":"","institution":"Helmholtz Munich","department":""},{"first_name":"Ishita","middle_name":"","last_name":"Dasgupta","name_suffix":"","institution":"Google DeepMind","department":""},{"first_name":"Jacques","middle_name":"","last_name":"Pesnot Lerousseau","name_suffix":"","institution":"Institut for Communication, Language and the Brain","department":""},{"first_name":"Marcel","middle_name":"","last_name":"Binz","name_suffix":"","institution":"Helmholtz Munich","department":""}],"date_submitted":null,"date_accepted":null,"date_published":"2024-01-01T18:00:00Z","render_galley":null,"galleys":[{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/21318/galley/10917/download/"},{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/21318/galley/15682/download/"},{"label":"PDF","type":"pdf","path":"https://journalpub.escholarship.org/cognitivesciencesociety/article/21318/galley/21263/download/"}]}